Skip to content

Fix Muon optimizer under ZeRO CPU offload and bound gather buffers - #8464

Draft
jinyouzhi wants to merge 17 commits into
deepspeedai:masterfrom
jinyouzhi:muon-cpu-offload-fix
Draft

Fix Muon optimizer under ZeRO CPU offload and bound gather buffers#8464
jinyouzhi wants to merge 17 commits into
deepspeedai:masterfrom
jinyouzhi:muon-cpu-offload-fix

Skip subgroups without an LP partition on universal restore

daa6261
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 10, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO