add zero-inference script - SemanticDiff

Commit

3 years ago

add zero-inference script

References

#308 - BLOOM Inference via DeepSpeed-Inference, Accelerate and DeepSpeed-ZeRO

Author

stas00

stas00

Parents

Loading