llama.cpp
kv cache : optimize restoring non-contiguous cells
#27991

Merged

kv cache : optimize restoring non-contiguous cells #27991

ggerganov merged 4 commits into ggml-org:master from itsnotoger:kv-restore-run-batch

itsnotoger requested a review from

ggerganov 4 days ago

github-actions added testing

itsnotoger changed the title ~~Kv restore run batch~~ kv cache : optimize restoring non-contiguous cells 4 days ago

kv cache : batch state restore scatter reads per contiguous run

ae89c2cc

context : fall back to the byte cursor when read and write chunking d…

a0a8aab5

itsnotoger force pushed from 7ef363b0 to 5b56771e 4 days ago

tests : cover state restore scatter reads on host and on-device paths

e1e96a8b

itsnotoger force pushed from 5b56771e to e1e96a8b 4 days ago

ggerganov commented on 2026-08-30

ggerganov assigned

ggerganov 4 days ago

Merge branch 'ggml-org:master' into kv-restore-run-batch

9e352f51

ggerganov merged 2d8d612e into master 2 days ago

Reviewers

ggerganov

Assignees

ggerganov

Labels

testing

Milestone

No milestone