llama.cpp
3e63a58e
- kv-cache : refactor the update/defrag mechanism (#13988)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
189 days ago
kv-cache : refactor the update/defrag mechanism (#13988) * kv-cache : refactor update mechanism ggml-ci * memory : improve status handling * defrag : reset head + add comments ggml-ci * cont : minor fixes ggml-ci
References
#13988 - kv-cache : refactor the update/defrag mechanism
Author
ggerganov
Parents
2589ad37
Loading