llama.cpp
79cb8f00
- llama : keep track of used KV cells + better KV cache management
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
llama : keep track of used KV cells + better KV cache management
References
#4170 - llama : KV cache view API + better KV cache management
Author
ggerganov
Parents
8e672efe
Loading