llama.cpp
4783b114 - llama : move the indexer key rotation choice into the model classes (#32653)

Commit
1 day ago
llama : move the indexer key rotation choice into the model classes (#32653) * llama : move the indexer key rotation choice into the model classes The KV cache forced a Hadamard rotation for the lightning indexer keys based on a list of architectures. The virtual llama_model::indexer_k_rot() now returns true for the same models. DeepSeek4.1 inherits from DeepSeek4 but was not in the list, so it overrides it back to false. * llama : rename indexer_k_rot() to lid_k_hdmd()
Author
Parents
Loading