DeepSpeed
16281df2 - fixed tracking for multiple param groups

Commit

4 years ago

fixed tracking for multiple param groups

References

#1453 - Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support)

Author

Justin Chiu

Parents

Loading