DeepSpeed
0b80ad06 - Make reduce scatter optional for ZeRO-1 as workaround (#971)

Commit
4 years ago
Make reduce scatter optional for ZeRO-1 as workaround (#971) * Make reduce scatter optional for ZeRO-1 as workaround * Make allreduce default for ZeRO 1 Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Author
Parents
Loading