DeepSpeed
a56ffec0
- Merge branch 'master' into tohtana/z3_moe_bwd
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Merge branch 'master' into tohtana/z3_moe_bwd
References
#5008 - Delay reduce-scatter for ZeRO3 leaf modules
Author
tohtana
Parents
93268f30
0dd0c615
Loading
