DeepSpeed
a9879b89
- Handle Norm allreduce when no mp
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
Handle Norm allreduce when no mp
References
#1021 - ZeRO3: Gradient norm allreduce for DP
Author
tjruwase
Parents
a8cf887d
Loading
