DeepSpeed
4ff2cfe8 - Make reduce scatter optional for ZeRO-1 as workaround

Commit

4 years ago

Make reduce scatter optional for ZeRO-1 as workaround

References

#971 - Make reduce scatter optional for ZeRO-1 as workaround

Author

tjruwase

tjruwase

Parents

Loading