DeepSpeed
c35f2371 - pick best max elems per comm to reduce extra padding

Commit

4 years ago

pick best max elems per comm to reduce extra padding

References

#532 - ZeRO-1 tune max-elems + bug fix

Author

jeffra

jeffra

Committer

jeffra

jeffra

Parents

Loading