Skip to content

Gather zero-sized parameters in ZeRO-3 - #8375

Open
alanhuangyoo wants to merge 4 commits into
deepspeedai:masterfrom
alanhuangyoo:fix/zero3-zero-sized-params
Open

Gather zero-sized parameters in ZeRO-3#8375
alanhuangyoo wants to merge 4 commits into
deepspeedai:masterfrom
alanhuangyoo:fix/zero3-zero-sized-params

Address review: coalesced gather, quantizer, prefetch gate

889e4b5
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 9, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO