llama.cpp
vulkan: disable FA mask_opt on GCN to improve performance
#24362
Merged

vulkan: disable FA mask_opt on GCN to improve performance #24362

0cc4m merged 2 commits into master from 0cc4m/vulkan-fa-mask-opt-gcn
0cc4m
0cc4m 0cc4m requested a review 110 days ago
github-actions github-actions added Vulkan
github-actions github-actions added ggml
jeffbolznv
0cc4m
engrtipusultan
jeffbolznv
0cc4m vulkan: disable FA mask_opt on GCN to improve performance
d7382603
0cc4m reenable mask opt over attention head size 256
78946e32
0cc4m 0cc4m force pushed from 6c2cbc4e to 78946e32 89 days ago
0cc4m
0cc4m
jeffbolznv
jeffbolznv
jeffbolznv approved these changes on 2026-07-08
0cc4m
ruixiang63
ruixiang63 approved these changes on 2026-07-08
0cc4m 0cc4m merged a646006f into master 81 days ago
0cc4m 0cc4m deleted the 0cc4m/vulkan-fa-mask-opt-gcn branch 81 days ago
engrtipusultan
0cc4m

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone