llama.cpp

9d3aba6b - CUDA: use MMVF for thin f16/bf16 mul_mat at small batch size (#29633)

CUDA: use MMVF for thin f16/bf16 mul_mat at small batch size (#29633) * CUDA: use MMVF for thin f16/bf16 mul_mat at small batch size Signed-off-by: ynankani <ynankani@nvidia.com> * adjust kernel selection logic --------- Signed-off-by: ynankani <ynankani@nvidia.com> Co-authored-by: Johannes Gäßler <johannesg@5d6.de>