DeepSpeed
fccbd950
- Merge branch 'master' into tohtana/z3_moe_bwd
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Merge branch 'master' into tohtana/z3_moe_bwd
References
#5008 - Delay reduce-scatter for ZeRO3 leaf modules
Author
tohtana
Parents
08770b8c
93e9537d
Loading
