llama.cpp
404f557b
- vulkan: use 4 rows for NVIDIA MUL_MAT_ID MMVQ (#29274)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
30 days ago
vulkan: use 4 rows for NVIDIA MUL_MAT_ID MMVQ (#29274) Keep the existing RDNA3/4 policy unchanged and update only rm_id to use 4 rows for NVIDIA except pre-Turing.
References
#29274 - vulkan: use 4 rows for NVIDIA MUL_MAT_ID MMVQ except pre-Turing
Author
SG-Amadeus
Parents
b797c82c
Loading