llama.cpp
986b3da7
- llama : offload KV cache per-layer
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
llama : offload KV cache per-layer
References
#4309 - llama : per-layer KV cache
Author
ggerganov
Committer
ggerganov
Parents
c294c78e
Loading