DeepSpeed
Fix Zero3 contiguous grads, reduce scatter false accuracy issue
#4321

Merged

Fix Zero3 contiguous grads, reduce scatter false accuracy issue #4321

tjruwase merged 2 commits into deepspeedai:master from nelyahu:master

Fix Zero3 contiguous grads, reduce scatter false accuracy issue

1a6aeb3f

nelyahu requested a review from

jeffra 2 years ago

nelyahu requested a review from

tjruwase 2 years ago

nelyahu requested a review from

samyam 2 years ago

nelyahu requested a review from

mrwyattii 2 years ago

Merge branch 'master' into master

c02e4d3e

tjruwase approved these changes on 2023-09-14

tjruwase merged 11aa880e into master 2 years ago

Reviewers

tjruwase

jeffra

samyam

mrwyattii

Assignees

No one assigned

Labels

None yet

Milestone

No milestone