llama.cpp
6788edb4
- vulkan: small M matrix optimizations for qwen (#28457)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
53 days ago
vulkan: small M matrix optimizations for qwen (#28457) * vulkan: optimize m=1 mul_mat by swapping A/B * vulkan: Improve small M perf Allow split_k with small M. Make small vs med tile selection (for coopmat2) depend on M, not just N.
References
#28457 - vulkan: small M matrix optimizations for qwen
Author
jeffbolznv
Parents
52d42686
Loading