DeepSpeed
bd9f3ef6 - Fix memory alignment bug in Stage 3 that gets triggered when number of params are not multiple of the world size

Commit

5 years ago

Fix memory alignment bug in Stage 3 that gets triggered when number of params are not multiple of the world size

Author

samyam

Parents