llama.cpp

2744e48d - CUDA: faster MMVQ for low-bit types (#30517)

CUDA: faster MMVQ for low-bit types (#30517) * CUDA: faster MMVQ for low-bit types * ggml-cuda: hip: small nwarps GCN fix on Q3_K(ncols=2,3), Q6_K(ncols=4) --------- Co-authored-by: thelittlefireman <thelittlefireman3@gmail.com>