DeepSpeed
3c12b899 - fix the large-batch inference for MP > 1

Commit

3 years ago

fix the large-batch inference for MP > 1

References

#2083 - Add Inference support for running the BigScience-BLOOM Architecture

Author

Reza Yazdani

Parents

Loading