DeepSpeed
9377921a
- Separate ZeRO3 InflightParamRegistry for train and eval (#3884)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Separate ZeRO3 InflightParamRegistry for train and eval (#3884) * create standalone registries for training and eval respectively --------- Co-authored-by: Ammar Ahmad Awan <ammar.awan@microsoft.com>
References
#3884 - Separate ZeRO3 InflightParamRegistry for train and eval
Author
HeyangQin
Parents
db4638d1
Loading