DeepSpeed
[zero++] Synchronize at the end of secondary partitioning and simplify the logic
#5216
Merged
Overview
Commits
5
Changes
View On GitHub

[zero++] Synchronize at the end of secondary partitioning and simplify the logic #5216

samadejacobs merged 5 commits into deepspeedai:master from ByronHsu:byhsu/fix-2nd-nan
ByronHsu
Synchronize at the end of secondary partitioning
644a822d
trim
18967fcf
trim
d36ec0c6
ByronHsu ByronHsu requested a review from tjruwase tjruwase 1 year ago
ByronHsu ByronHsu requested a review from mrwyattii mrwyattii 1 year ago
tjruwase
tjruwase
tjruwase approved these changes on 2024-03-01
simplify parition logic
9837fccf
ByronHsu ByronHsu changed the title [zero++] Synchronize at the end of secondary partitioning [zero++] Synchronize at the end of secondary partitioning and simplify the logic 1 year ago
only sync current stream
00e76e99
samadejacobs samadejacobs merged 4578c249 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum