DeepSpeed
806b0726 - using base allgather params when only 1 param

Commit

4 years ago

using base allgather params when only 1 param

References

#1453 - Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support)

Author

Justin Chiu

Committer

Justin Chiu

Parents

Loading