llama.cpp
40cbf571
- kv-cache : fix shift and defrag logic (#14081)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
148 days ago
kv-cache : fix shift and defrag logic (#14081) * kv-cache : fix shift ggml-ci * cont : reset shift[i] ggml-ci * cont : fix defrag erasing cells that didn't move ggml-ci
References
#14081 - kv-cache : fix shift and defrag logic
Author
ggerganov
Parents
7f4fbe51
Loading