DeepSpeed
db5a3b7f
- use the num_kv param only if it is positive
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
use the num_kv param only if it is positive
References
#4313 - Add the policy to run llama model from the official repo
#4351 - DS-Inference Quantization refresh: Fix several issues and add more features
Author
Reza Yazdani
Parents
ca61bd1e
Loading