DeepSpeed
[zero2] zero_param_shapes: switch to round_robin_fp16_groups
#1240
Merged

Loading