DeepSpeed
c33bc4fd - use num_kv only when it has positive value

Commit

2 years ago

use num_kv only when it has positive value

References

#4313 - Add the policy to run llama model from the official repo

#4351 - DS-Inference Quantization refresh: Fix several issues and add more features

Author

Reza Yazdani

Parents

Loading