DeepSpeed
ca5cff6a
- add api to get leaf modules
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
add api to get leaf modules
References
#5008 - Delay reduce-scatter for ZeRO3 leaf modules
Author
Masahiro Tanaka
Parents
a56ffec0
Loading
