llama.cpp
1f5161c8 - glm5-next : drop the q_absorbed cont

Commit
8 days ago
glm5-next : drop the q_absorbed cont The meta backend can now split the per-stream view of the permuted q, so the cont is not needed for -sm tensor with a non-unified KV cache. With the cont, the q of flash attention was not contiguous, and when FA ran on the CPU (WebGPU) the meta get_tensor aborted.
Author
Committer
Parents
Loading