DeepSpeed
Keep fp32 masters on ZeRO-1 and ZeRO-2 when a resume skips optimizer state
#8891
Merged

Loading