llama.cpp
vulkan: apply MUL_MAT_ID subgroup optimization to non-coopmat devices
#15524

Merged

vulkan: apply MUL_MAT_ID subgroup optimization to non-coopmat devices #15524

0cc4m merged 4 commits into master from 0cc4m/vulkan-mmid-subgroup

vulkan: use subgroup function for mul_mat_id shader even without coopmat

170a0ae4

vulkan: fix compile warnings

fe591d24

0cc4m requested a review from

jeffbolznv 304 days ago

github-actions added Vulkan

github-actions added ggml

0cc4m changed the title ~~0cc4m/vulkan mmid subgroup~~ vulkan: apply MUL_MAT_ID subgroup optimization to non-coopmat devices 304 days ago

jeffbolznv commented on 2025-08-23

netrunnereve commented on 2025-08-23

vulkan: properly check for subgroup size control and require full sub…

0c822f0f

vulkan: disable subgroup mul_mat_id on devices with subgroups < 16

034da0a3

jeffbolznv approved these changes on 2025-08-24

0cc4m merged 043fb27d into master 302 days ago

0cc4m deleted the 0cc4m/vulkan-mmid-subgroup branch 302 days ago

Reviewers

jeffbolznv

netrunnereve

Assignees

No one assigned

Labels

Vulkan ggml

Milestone

No milestone