Gather zero-sized parameters in ZeRO-3 - #8375

Open

alanhuangyoo wants to merge 4 commits into

deepspeedai:masterfrom

alanhuangyoo:fix/zero3-zero-sized-params

Commits on Aug 31, 2026

Gather zero-sized parameters in ZeRO-3
alanhuangyoo
committed
50da554

Commits on Sep 9, 2026

Merge remote-tracking branch 'upstream/master' into fix/zero3-zero-sized-params
alanhuangyoo
committed
ece8aa2
Scope this to ZeRO-3; stages 1 and 2 fail from a different place
alanhuangyoo
committed
5cda14e
Address review: coalesced gather, quantizer, prefetch gate
alanhuangyoo
committed
889e4b5