llama.cpp
vulkan: small M matrix optimizations for qwen
#28457
Merged

vulkan: small M matrix optimizations for qwen #28457

jeffbolznv
jeffbolznv jeffbolznv requested a review from ggerganov ggerganov 58 days ago
jeffbolznv jeffbolznv requested a review 58 days ago
github-actions github-actions added testing
github-actions github-actions added Vulkan
github-actions github-actions added ggml
jeffbolznv vulkan: optimize m=1 mul_mat by swapping A/B
7a1140bf
jeffbolznv vulkan: Improve small M perf
3bee02bc
jeffbolznv jeffbolznv force pushed to 3bee02bc 54 days ago
0cc4m
0cc4m approved these changes on 2026-09-10
0cc4m
jeffbolznv
0cc4m
0cc4m 0cc4m added merge ready
ggerganov ggerganov merged 6788edb4 into master 53 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone