DeepSpeed
e9b5dffa
- dont clear grads in stage 1 code path
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
dont clear grads in stage 1 code path
References
#1400 - Big science fix passing multiple tensors
Author
jeffra
Parents
f93e22b3
Loading
