llama.cpp
8777c0c8 - Title: CUDA: few-row MMQ for MUL_MAT_ID (#32065)

Commit
1 day ago
Title: CUDA: few-row MMQ for MUL_MAT_ID (#32065) * CUDA: few-row MMQ for MUL_MAT_ID * CUDA: few-row MMQ for MUL_MAT_ID from 2 tokens on DGX Spark * CUDA: few-row MUL_MAT_ID: one launcher, tighter pair count, more tests * CUDA: few-row MUL_MAT_ID: dispatch order MMVQ, few-row, MMQ and review fixes
Author
Parents
Loading