llama.cpp

7d1a378b - CUDA: refactor mmq, dmmv, mmvq (#7716)

CUDA: refactor mmq, dmmv, mmvq (#7716) * CUDA: refactor mmq, dmmv, mmvq * fix out-of-bounds write * struct for qk, qr, qi * fix cmake build * mmq_type_traits