ZeRO-3: don't partition frozen params during an activation-checkpoint recompute#8130

qgallouedec wants to merge 7 commits into

deepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

qgallouedec:fix/zero3-frozen-param-checkpoint-recomputeqgallouedec/DeepSpeed:fix/zero3-frozen-param-checkpoint-recomputeCopy head branch name to clipboard