DeepSpeed
Fix ZeRO 2 + Pipelining
#677
Merged

Fix ZeRO 2 + Pipelining #677

ShadenSmith merged 4 commits into deepspeedai:master from leogao2:patch-1
leogao2
leogao2 Fix ZeRO 2 + Pipelining
d4cc9601
leogao2 leogao2 requested a review from arashashari arashashari 5 years ago
leogao2 leogao2 requested a review from awan-10 awan-10 5 years ago
leogao2 leogao2 requested a review from cli99 cli99 5 years ago
leogao2 leogao2 requested a review from conglongli conglongli 5 years ago
leogao2 leogao2 requested a review from eltonzheng eltonzheng 5 years ago
leogao2 leogao2 requested a review from jeffra jeffra 5 years ago
leogao2 leogao2 requested a review from minjiaz minjiaz 5 years ago
leogao2 leogao2 requested a review from niumanar niumanar 5 years ago
leogao2 leogao2 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
leogao2 leogao2 requested a review from samyam samyam 5 years ago
leogao2 leogao2 requested a review from ShadenSmith ShadenSmith 5 years ago
leogao2 leogao2 requested a review from tjruwase tjruwase 5 years ago
ShadenSmith ShadenSmith added bug
ShadenSmith
ShadenSmith
ShadenSmith approved these changes on 2021-01-20
Merge branch 'master' into patch-1
9a3141e5
ShadenSmith
jeffra formatting
3bec6bf9
Merge branch 'master' into patch-1
1eb6b99f
ShadenSmith ShadenSmith merged 34c83a5a into master 5 years ago
ShadenSmith

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone