llama.cpp
1bded5a3
- kv-cache : better estimate of n_kv for multi-sequence batches (#15610)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
11 days ago
kv-cache : better estimate of n_kv for multi-sequence batches (#15610) ggml-ci
References
#15610 - kv-cache : better estimate of n_kv for multi-sequence batches
Author
ggerganov
Parents
1e748974
Loading