PR #6550 Fix gradient accumulation for Z2+offload

Fix gradient accumulation for Z2+offload #6550

tjruwase merged 3 commits into deepspeedai:master from tohtana:tohtana/fix_grad_acc_z2_offload

fix gradient accumulation for z2+offload

18489835

tohtana requested a review from

tjruwase 1 year ago

tjruwase approved these changes on 2024-09-18

Merge branch 'master' into tohtana/fix_grad_acc_z2_offload

3a37b030

Merge branch 'master' into tohtana/fix_grad_acc_z2_offload

3ee184cb

tjruwase merged c85c8703 into master 1 year ago

Reviewers

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone