DeepSpeed
f5dde36c - Fix RuntimeError when using ZeRO Stage3 with mpu: #3564 (#3565)

Commit

2 years ago

Fix RuntimeError when using ZeRO Stage3 with mpu: #3564 (#3565) Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>

References

Author

eggiter

Parents