lighteval
16c26303
- adds `enable_prefix_caching` option to VLLMModelConfig (#945)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
84 days ago
adds `enable_prefix_caching` option to VLLMModelConfig (#945) * add enable_prefix_caching in VLLMModel * typo * None default value --------- Co-authored-by: Nathan Habib <30601243+NathanHB@users.noreply.github.com>
References
#945 - adds `enable_prefix_caching` option to VLLMModelConfig
Author
GAD-cell
Parents
5a0e8972
Loading