llama.cpp
6f767fe9 - ggml-cpu: enable tiled flash attention for non-vector-multiple head dims on x86 (#29423)

Commit
26 days ago
ggml-cpu: enable tiled flash attention for non-vector-multiple head dims on x86 (#29423) * ggml-cpu: enable tiled flash attention for non-vector-multiple head dims on x86 * add AVX2 support for masked loading and storing in simd_gemm_ukernel_tail * ggml-cpu: fix FA softcap handling for padded KV tiles
Author
Parents
Loading