DeepSpeed
08770b8c
- Merge branch 'master' into tohtana/z3_moe_bwd
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Merge branch 'master' into tohtana/z3_moe_bwd
References
#5008 - Delay reduce-scatter for ZeRO3 leaf modules
Author
tjruwase
Parents
ca5cff6a
6e1a6801
Loading
