Skip to content

Partition AutoEP expert parameters per layer under ZeRO-3 - #8424

Open
tohtana wants to merge 3 commits into
deepspeedai:masterfrom
tohtana:tohtana/fix-autoep-zero3-init-memory-peak
Open

Partition AutoEP expert parameters per layer under ZeRO-3#8424
tohtana wants to merge 3 commits into
deepspeedai:masterfrom
tohtana:tohtana/fix-autoep-zero3-init-memory-peak

Preserve AutoEP expert optimizer grouping

03d2ffb
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 5, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO