DeepSpeed
3a37b030
- Merge branch 'master' into tohtana/fix_grad_acc_z2_offload
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Merge branch 'master' into tohtana/fix_grad_acc_z2_offload
References
#6554 - Improve consistency of zero_grad
#6550 - Fix gradient accumulation for Z2+offload
Author
tjruwase
Parents
18489835
2a56f533
Loading
