llama.cpp
5cdd3d1d - model : fix MTP context kv cache allocation for deepseek2, glm4moe, … (#28630)

Commit
39 days ago
model : fix MTP context kv cache allocation for deepseek2, glm4moe, … (#28630) * model : fix MTP context kv cache allocation for deepseek2, glm4moe, cohere2moe architectures (#28626) * model: add inverse architecture gating and comprehensive architecture testing for mtp layer filtering * model : slim NextN filter comment, drop test-llama-archs changes
Author
Parents
Loading