DeepSpeed
fba92f19
- Hotfix ZeRO-1 memory/convergence fixes (#527)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Hide Minimap (CTRL+M)
Commit
4 years ago
Hotfix ZeRO-1 memory/convergence fixes (#527) * updates to simplify and fix memory/convergence bugs * disable model tests
References
#527 - Hotfix ZeRO-1 memory/convergence fixes
Author
jeffra
Parents
0fda51ad
Files
2
azure-pipelines.yml
deepspeed/pt
zero_optimizer_stage1.py
Loading
zero_optimizer_stage1.py