DeepSpeed
e92f7c91 - Fix RuntimeError when using ZeRO Stage3 with mpu: #3564 (#3565)

Commit

2 years ago

Fix RuntimeError when using ZeRO Stage3 with mpu: #3564 (#3565) Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>

Author

eggiter

Committer

molly-smith

Parents