Skip to content

[AutoTP] Add support for vocab-parallel LM head and related configurations - #8309

Open
jinyouzhi wants to merge 6 commits into
deepspeedai:masterfrom
jinyouzhi:vocab_parallel_ce
Open

[AutoTP] Add support for vocab-parallel LM head and related configurations#8309
jinyouzhi wants to merge 6 commits into
deepspeedai:masterfrom
jinyouzhi:vocab_parallel_ce

Validate vocab head before AutoTP

a47d7ab
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 8, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO