llama.cpp
21079106 - kv-cache: fix restoring mismatched KV cache rotation by saving exact rotation metadata (#28498)

Commit
3 days ago
kv-cache: fix restoring mismatched KV cache rotation by saving exact rotation metadata (#28498) * kv-cache: save exact KV rotation metadata, reject restoring mismatched rotation * tests : move the state rotation test to test-save-load-state the test is now part of the save/load test matrix and runs against every model under test, like the rest of the suite it probes the KV cache type combinations supported by the model and treats models that do not use attention rotation as passing vacuously Assisted-by: pi:llama.cpp/Qwen3.8-27B * cont : skip unsupported KV caches --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
Loading