llama.cpp
vulkan: sparse flash attention for quantized K/V
#29639
Merged

vulkan: sparse flash attention for quantized K/V #29639

0cc4m merged 2 commits into ggml-org:master from fxgsell:vk-sparse-fa-quant
fxgsell
fxgsell vulkan: sparse flash attention for quantized K/V
61be16b6
fxgsell fxgsell requested a review from ggerganov ggerganov 15 days ago
fxgsell fxgsell requested a review 15 days ago
github-actions github-actions added testing
github-actions github-actions added Vulkan
github-actions github-actions added ggml
jeffbolznv
fxgsell vulkan: single-scan sparse FA index compaction
0cdb384c
fxgsell
fxgsell
jeffbolznv
jeffbolznv
jeffbolznv approved these changes on 2026-10-03
0cc4m
0cc4m approved these changes on 2026-10-05
0cc4m 0cc4m merged b3daa077 into master 9 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone