DeepSpeed
Add gradient_average flag support for sparse grads
#2188
Merged
Overview
Commits
5
Changes
View On GitHub

Add gradient_average flag support for sparse grads #2188

tjruwase merged 5 commits into deepspeedai:master from Dipet:master
Dipet
Dipet Add gradient_average flag support for sparse grads
3691f747
Dipet Dipet requested a review from jeffra jeffra 3 years ago
Dipet Dipet requested a review from samyam samyam 3 years ago
Dipet Dipet requested a review from tjruwase tjruwase 3 years ago
Dipet Dipet requested a review from ShadenSmith ShadenSmith 3 years ago
Dipet Dipet requested a review from conglongli conglongli 3 years ago
Dipet Dipet requested a review from awan-10 awan-10 3 years ago
Dipet Dipet requested a review from cli99 cli99 3 years ago
Dipet Dipet requested a review from eltonzheng eltonzheng 3 years ago
Dipet Dipet requested a review from minjiaz minjiaz 3 years ago
Dipet Dipet requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
Dipet Dipet requested a review from duli2012 duli2012 3 years ago
Dipet Dipet requested a review from mrwyattii mrwyattii 3 years ago
Dipet Dipet requested a review from yaozhewei yaozhewei 3 years ago
Dipet Dipet requested a review from arashb arashb 3 years ago
Dipet Dipet requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
Dipet Dipet requested a review from samadejacobs samadejacobs 3 years ago
Dipet formatting fixes
353bbfc6
Dipet Add tests
d83a2590
Dipet
Dipet Merge branch 'master' into master
9bf6de49
Dipet
tjruwase
tjruwase approved these changes on 2022-08-09
tjruwase Merge branch 'master' into master
2f7f2963
tjruwase tjruwase merged b62e0cc5 into master 3 years ago
tjruwase

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum