DeepSpeed
3e11f4c7
- Merge branch 'master' into olruwase/zero3_dp_norm_allreduce
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
Merge branch 'master' into olruwase/zero3_dp_norm_allreduce
References
olruwase/zero3_dp_norm_allreduce
#1021 - ZeRO3: Gradient norm allreduce for DP
Author
jeffra
Parents
a9879b89
dad26428
Loading