PR #5606 Fix overlap communication of ZeRO stage 1 and 2

Fix overlap communication of ZeRO stage 1 and 2 #5606

tjruwase merged 3 commits into deepspeedai:master from penn513:master

penn513 requested a review from

tjruwase 1 year ago

penn513 requested a review from

mrwyattii 1 year ago

penn513 force pushed from 085086fe to 6a001f95 1 year ago

penn513 force pushed from 6a001f95 to 13198701 1 year ago

tjruwase removed review request from

mrwyattii 1 year ago

tjruwase requested a review from

GuanhuaWang 1 year ago

fix overlap comm bug for ZeRO stage 1&2

6c753815

penn513 force pushed from 13198701 to 6c753815 1 year ago

Merge branch 'master' into master

4074eb41

jomayeri approved these changes on 2024-06-07

Merge branch 'master' into master

604e9d3d

loadams enabled auto-merge 1 year ago

tjruwase merged a41729f6 into master 1 year ago

Reviewers

jomayeri

tjruwase

GuanhuaWang

Assignees

No one assigned

Labels

None yet

Milestone

No milestone