DeepSpeed
[Zero2] Reduce the unnecessary all-reduce when tensor size is 0.
#5868
Merged
Overview
Commits
2
Changes
View On GitHub

[Zero2] Reduce the unnecessary all-reduce when tensor size is 0. #5868

tjruwase merged 2 commits into deepspeedai:master from ys950902:zero2
ys950902
ys950902 reduce the unecessary allreduce when tensor size is 0
15461259
ys950902 ys950902 requested a review from tjruwase tjruwase 1 year ago
tjruwase
tjruwase approved these changes on 2024-08-07
tjruwase Merge branch 'master' into zero2
3963aa00
tjruwase tjruwase merged 24d1d86b into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum