DeepSpeed
0ccb2bb6
- Fix gradient is ready with z2 (#7829)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
6 days ago
Fix gradient is ready with z2 (#7829) Correctly handle `ds_grad_is_ready` in ZeRO2 --------- Signed-off-by: Olatunji Ruwase <tunji.ruwase@snowflake.com>
References
#7829 - Fix gradient is ready with z2
Author
sfc-gh-truwase
Parents
6b9cab1d
Loading