llama.cpp
14d75706
- llama : add llama_kv_cache_compress (EXPERIMENTAL)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
llama : add llama_kv_cache_compress (EXPERIMENTAL)
References
gg/kv-compress
#5719 - llama : add llama_kv_cache_compress
Author
ggerganov
Committer
ggerganov
Parents
c24a2a6e
Loading
