DeepSpeed
Fix buffer size for pipeline parallel and communication schedule
#2862
Merged
Overview
Commits
6
Changes
View On GitHub

Fix buffer size for pipeline parallel and communication schedule #2862

mrwyattii merged 6 commits into master from tohtana/fix_pipeline_buffer
tohtana
fix buffer size for pipeline parallel (#2800)
bb157cc4
tohtana tohtana requested a review from ShadenSmith ShadenSmith 3 years ago
tohtana tohtana requested a review from duli2012 duli2012 3 years ago
tohtana tohtana changed the title fix buffer size for pipeline parallel (#2800) Fix buffer size for pipeline parallel and communication schedule 3 years ago
jaywonchung
jaywonchung commented on 2023-02-20
ShadenSmith
ShadenSmith approved these changes on 2023-03-07
jeffra Merge branch 'master' into tohtana/fix_pipeline_buffer
c5d90560
tohtana improve explanation of buffer size for pipeline parallelism
65c20bd6
fix format of comment
a8ad7969
tjruwase Merge branch 'master' into tohtana/fix_pipeline_buffer
70257f47
tjruwase Merge branch 'master' into tohtana/fix_pipeline_buffer
d4d9f7ac
mrwyattii mrwyattii merged b528f50e into master 3 years ago
tohtana tohtana deleted the tohtana/fix_pipeline_buffer branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum