DeepSpeed
Fix zero-1 bug related to stitching reduced grads across comm partitions
#318

Merged

Fix zero-1 bug related to stitching reduced grads across comm partitions #318

jeffra merged 1 commit into master from jeffra/zero-1-fix

jeffra added bug

jeffra requested a review from

samyam 5 years ago

jeffra requested a review from

tjruwase 5 years ago

samyam commented on 2020-08-20

jeffra requested a review from

arashashari 5 years ago

jeffra requested a review from

awan-10 5 years ago

jeffra requested a review from

cli99 5 years ago

jeffra requested a review from

conglongli 5 years ago

jeffra requested a review from

eltonzheng 5 years ago

jeffra requested a review from

minjiaz 5 years ago

jeffra requested a review from

niumanar 5 years ago

jeffra requested a review from

RezaYazdaniAminabadi 5 years ago

jeffra requested a review from

ShadenSmith 5 years ago

fix bug related to stitching reduced grads across communication parti…

eb287ddd

jeffra force pushed from 55284a22 to eb287ddd 5 years ago

jeffra merged 55ed1057 into master 5 years ago

jeffra deleted the jeffra/zero-1-fix branch 5 years ago

Reviewers

samyam

tjruwase

arashashari

awan-10

cli99

conglongli

eltonzheng

minjiaz

niumanar

RezaYazdaniAminabadi

ShadenSmith

Assignees

No one assigned

Labels

bug

Milestone

No milestone

DeepSpeed Fix zero-1 bug related to stitching reduced grads across comm partitions #318 Merged

Fix zero-1 bug related to stitching reduced grads across comm partitions #318

DeepSpeed
Fix zero-1 bug related to stitching reduced grads across comm partitions
#318

Merged