llama.cpp
404f557b - vulkan: use 4 rows for NVIDIA MUL_MAT_ID MMVQ (#29274)

Commit
30 days ago
vulkan: use 4 rows for NVIDIA MUL_MAT_ID MMVQ (#29274) Keep the existing RDNA3/4 policy unchanged and update only rm_id to use 4 rows for NVIDIA except pre-Turing.
Author
Parents
Loading