DeepSpeed
a26e9af4
- fix(superoffload): preserve param group mapping across ZeRO-3 subgroups
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
12 days ago
fix(superoffload): preserve param group mapping across ZeRO-3 subgroups
References
#7906 - fix(superoffload) preserve multi-group updates with shared cpu buffers (#7905)
Author
xylian86
Parents
5f7b6870
Loading