DeepSpeed
c33bc4fd
- use num_kv only when it has positive value
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
use num_kv only when it has positive value
References
#4313 - Add the policy to run llama model from the official repo
#4351 - DS-Inference Quantization refresh: Fix several issues and add more features
Author
Reza Yazdani
Parents
165042df
Loading