DeepSpeed
db5a3b7f - use the num_kv param only if it is positive

Commit

2 years ago

use the num_kv param only if it is positive

References

#4313 - Add the policy to run llama model from the official repo

#4351 - DS-Inference Quantization refresh: Fix several issues and add more features

Author

Reza Yazdani

Parents

Loading