change the mp based on the world_size - SemanticDiff

Commit

3 years ago

change the mp based on the world_size

References

#308 - BLOOM Inference via DeepSpeed-Inference, Accelerate and DeepSpeed-ZeRO

Author

Reza Yazdani

Parents

Loading