DeepSpeed
3ca9878d - stage_1_and_2.py: no allreduce needed when mp size is 1 (#2494)

Commit

3 years ago

stage_1_and_2.py: no allreduce needed when mp size is 1 (#2494)

References

#2494 - stage_1_and_2.py: no allreduce needed when mp size is 1

Author

guoyejun

guoyejun

Parents

Loading