DeepSpeed
e1ff8bab
- Unit test for unbalanced gradients in ZeRO
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
5 years ago
Unit test for unbalanced gradients in ZeRO
References
#545 - Fix unbalanced gradients bug in ZeRO-2 gradient accumulation
Author
tjruwase
Parents
0bb0cc80
Loading
