DeepSpeed
Attach empty grad to its param to ensure it's copied after reduction
#316

Merged

Attach empty grad to its param to ensure it's copied after reduction #316

jeffra merged 1 commit into master from jeffra/emptygradfix

attach empty grad to its param to ensure it's copied after reduction

60a9b062

jeffra requested a review from

samyam 5 years ago

samyam approved these changes on 2020-08-13

jeffra added bug

jeffra merged e1bea67f into master 5 years ago

jeffra deleted the jeffra/emptygradfix branch 5 years ago

jeffra restored the head branch 5 years ago

jeffra deleted the jeffra/emptygradfix branch 5 years ago

Reviewers

samyam

Assignees

No one assigned

Labels

bug

Milestone

No milestone