llama.cpp
d20426bb - vulkan: optimize matrix multiplication for narrow N (#31990)

Commit
1 day ago
vulkan: optimize matrix multiplication for narrow N (#31990) * vulkan: optimize matrix multiplication for narrow N Add new "narrow" tile configs for coopmat1/coopmat2 that are tuned for N<=32. * Attempt to handle wave64 * add n=16 tile for cm1 * apply RDNA split_k heuristic to narrow_n generally --------- Co-authored-by: Ruben Ortlam <rortlam@redhat.com>
Author
Parents
Loading