DeepSpeed
bd9f3ef6
- Fix memory alignment bug in Stage 3 that gets triggered when number of params are not multiple of the world size
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
5 years ago
Fix memory alignment bug in Stage 3 that gets triggered when number of params are not multiple of the world size
Author
samyam
Parents
6adc19a6
Loading