DeepSpeed
1a4a82b6
- change gpt2 pretrain to have DeepSpeed adam (#361)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
5 years ago
change gpt2 pretrain to have DeepSpeed adam (#361) Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
References
#361 - Manually calling step with DeepSpeed Adam passing in fp16 params
Author
samyam
Parents
7be128af
Loading