llama.cpp
e9bcf66a
- per-layer KV
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
per-layer KV
References
#4309 - llama : per-layer KV cache
Author
slaren
Committer
slaren
Parents
ff5a3f0c
Loading