Make allreduce default for ZeRO 1 - SemanticDiff

Commit

4 years ago

Make allreduce default for ZeRO 1

References

#971 - Make reduce scatter optional for ZeRO-1 as workaround

Author

tjruwase

tjruwase

Parents

Loading