DeepSpeed
14e22a25 - removed unused parameter offset bookkeeping

Commit

4 years ago

removed unused parameter offset bookkeeping

References

#1453 - Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support)

Author

Justin Chiu

Parents

Loading