llama.cpp
kv cache : optimize restoring non-contiguous cells
#27991

Merged

kv cache : optimize restoring non-contiguous cells #27991

ggerganov merged 4 commits into ggml-org:master from itsnotoger:kv-restore-run-batch

itsnotoger requested a review from

ggerganov 52 days ago

github-actions added testing

itsnotoger changed the title ~~Kv restore run batch~~ kv cache : optimize restoring non-contiguous cells 52 days ago

kv cache : batch state restore scatter reads per contiguous run

ae89c2cc

context : fall back to the byte cursor when read and write chunking d…

a0a8aab5

itsnotoger force pushed 52 days ago

tests : cover state restore scatter reads on host and on-device paths

e1e96a8b

itsnotoger force pushed to e1e96a8b 52 days ago

ggerganov commented on 2026-08-30

ggerganov assigned

ggerganov 52 days ago

Merge branch 'ggml-org:master' into kv-restore-run-batch

9e352f51

ggerganov merged 2d8d612e into master 50 days ago

itsnotoger deleted the kv-restore-run-batch branch 44 days ago

Reviewers

ggerganov

Assignees

ggerganov

Labels

testing

Milestone

No milestone