Skip to content

[JAX] Make MoEBlock aware of Dense TP axes - #3462

Draft
jberchtold-nvidia wants to merge 5 commits into
NVIDIA:mainfrom
jberchtold-nvidia:jberchtold/fix-tp-etp1-awareness-in-moeblock
Draft

[JAX] Make MoEBlock aware of Dense TP axes#3462
jberchtold-nvidia wants to merge 5 commits into
NVIDIA:mainfrom
jberchtold-nvidia:jberchtold/fix-tp-etp1-awareness-in-moeblock

Commits

Commits on Sep 2, 2026