DeepSpeed
Honor fp16 hysteresis in the ZeRO stage 0 fp16 optimizers
#8647
Merged

Loading