DeepSpeed
1cef202d - fix the padding issue for large bach inference

Commit

3 years ago

fix the padding issue for large bach inference

References

#2083 - Add Inference support for running the BigScience-BLOOM Architecture

Author

Reza Yazdani

Parents

Loading