llama.cpp
vulkan: add tiled-transpose concat shader for Qwen models
#30591

Merged

vulkan: add tiled-transpose concat shader for Qwen models #30591

ggerganov merged 6 commits into master from 0cc4m/vulkan-qwen-concat-fix

0cc4m requested a review 26 days ago

github-actions added Vulkan

github-actions added ggml

jeffbolznv commented on 2026-10-15

0cc4m requested a review from

ggerganov 22 days ago

github-actions added testing

0cc4m force pushed from 52e41a44 to cc28c8df 9 days ago

vulkan: tiled transpose for dim-0 concat with a transposed source

5795fcf3

enable by default, add smaller shader sizes

c5bef907

clean up comments

af6b215f

improve shader

ad5bb319

Add non-contiguous concat tests

429bf415

handle x or y axis overflow

90b7a327

0cc4m force pushed from cc28c8df to 90b7a327 1 day ago

jeffbolznv approved these changes on 2026-11-09

0cc4m added merge ready

ggerganov merged ae4893a0 into master 1 day ago

0cc4m deleted the 0cc4m/vulkan-qwen-concat-fix branch 1 day ago

Reviewers

jeffbolznv

ggerganov

Assignees

No one assigned

Labels

testing Vulkan ggml merge ready

Milestone

No milestone