DeepSpeed
8a8683d3 - Fix Issue 4083 (#4084)

Commit
2 years ago
Fix Issue 4083 (#4084) * removing bad check * adding offload check for bf16 optimizer * grad reduce for extra large param * check grad_accum exists before converting --------- Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>
Author
Parents
Loading