llama.cpp
kv-cache : better estimate of n_kv for multi-sequence batches
#15610
Merged
Merged
kv-cache : better estimate of n_kv for multi-sequence batches #15610
ggerganov
merged
1 commit into
master
from
gg/kv-cache-fix-n_kv
Login to write a write a comment.
Login via GitHub