DeepSpeed
0b80ad06
- Make reduce scatter optional for ZeRO-1 as workaround (#971)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
Make reduce scatter optional for ZeRO-1 as workaround (#971) * Make reduce scatter optional for ZeRO-1 as workaround * Make allreduce default for ZeRO 1 Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
References
#971 - Make reduce scatter optional for ZeRO-1 as workaround
Author
tjruwase
Parents
894f21da
Loading