PR #5420 Optimize zero3 fetch params using all_reduce

Optimize zero3 fetch params using all_reduce #5420

tjruwase merged 5 commits into deepspeedai:master from deepcharm:use-all-reduce-for-fetch-params

Optimize zero3 fetch params using all_reduce

31ae55ba

deepcharm requested a review from

tjruwase 1 year ago

deepcharm requested a review from

mrwyattii 1 year ago

tjruwase requested a review from

GuanhuaWang 1 year ago

tjruwase requested a review from

tohtana 1 year ago

tjruwase removed review request from

mrwyattii 1 year ago

Merge branch 'master' into use-all-reduce-for-fetch-params

ec511f44

Merge branch 'master' into use-all-reduce-for-fetch-params

cde67ab3

tjruwase commented on 2024-04-23

Merge branch 'master' into use-all-reduce-for-fetch-params

19787fa7

Merge branch 'master' into use-all-reduce-for-fetch-params

327bda88

tjruwase approved these changes on 2024-05-06

tjruwase merged 49df8d8d into master 1 year ago

deepcharm deleted the use-all-reduce-for-fetch-params branch 276 days ago

Reviewers

tjruwase

GuanhuaWang

tohtana

Assignees

No one assigned

Labels

None yet

Milestone

No milestone