add bloom batch-inference script - SemanticDiff

Commit

3 years ago

add bloom batch-inference script

References

#308 - BLOOM Inference via DeepSpeed-Inference, Accelerate and DeepSpeed-ZeRO

Author

Reza Yazdani

Parents

Loading