DeepSpeed
8a8683d3
- Fix Issue 4083 (#4084)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Fix Issue 4083 (#4084) * removing bad check * adding offload check for bf16 optimizer * grad reduce for extra large param * check grad_accum exists before converting --------- Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>
References
#4084 - Fix Issue 4083
Author
jomayeri
Parents
1e0c39c6
Loading