DeepSpeed
1cc9caa9 - [zero_to_fp32] 3x less cpu memory requirements (#4025)

Comment changes are shownComment changes are hidden
Commit
1 year ago
[zero_to_fp32] 3x less cpu memory requirements (#4025) * [zero_to_fp32] 3x less cpu memory requirements * safer version * style
Author
Parents
  • deepspeed/utils
    • File
      zero_to_fp32.py