DeepSpeed
fe728e3e
- using correct loss scale in zero step (#2695)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
using correct loss scale in zero step (#2695) Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
References
#2695 - Correct loss scale in ZeRO step
Author
jomayeri
Parents
cd271a4a
Loading