DeepSpeed
da1f41d3
- Merge branch 'master' into tohtana/z3_moe_bwd
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Merge branch 'master' into tohtana/z3_moe_bwd
References
#5008 - Delay reduce-scatter for ZeRO3 leaf modules
Author
tohtana
Parents
fccbd950
76ec8b49
Loading
