DeepSpeed
7392e459 - [zero2] zero_param_shapes: switch to round_robin_fp16_groups (#1240)

Commit

4 years ago

[zero2] zero_param_shapes: switch to round_robin_fp16_groups (#1240) * zero_param_shapes: switch to round_robin_fp16_groups * add test * old torch workaround

References

#1240 - [zero2] zero_param_shapes: switch to round_robin_fp16_groups

Author

stas00

Parents

32e85eda

DeepSpeed 7392e459 - [zero2] zero_param_shapes: switch to round_robin_fp16_groups (#1240)

DeepSpeed
7392e459 - [zero2] zero_param_shapes: switch to round_robin_fp16_groups (#1240)