Add support for multi-batch inference - SemanticDiff

Commit

3 years ago

Add support for multi-batch inference

References

#2083 - Add Inference support for running the BigScience-BLOOM Architecture

Author

Reza Yazdani

Parents

Loading