llama.cpp
Title: CUDA: few-row MMQ for MUL_MAT_ID
#32065
Merged

Title: CUDA: few-row MMQ for MUL_MAT_ID #32065

anujj merged 4 commits into ggml-org:master from anujj:anujj/few-row-mmid
anujj
github-actions github-actions added testing
github-actions github-actions added ggml
github-actions github-actions added CUDA
anujj CUDA: few-row MMQ for MUL_MAT_ID
e81135de
anujj CUDA: few-row MMQ for MUL_MAT_ID from 2 tokens on DGX Spark
501d145f
anujj CUDA: few-row MUL_MAT_ID: one launcher, tighter pair count, more tests
15dc909c
anujj CUDA: few-row MUL_MAT_ID: dispatch order MMVQ, few-row, MMQ and revie…
501669ea
anujj anujj force pushed from a8cbbe52 to 501669ea 5 days ago
anujj anujj marked this pull request as ready for review 5 days ago
anujj anujj requested a review from ggerganov ggerganov 5 days ago
anujj anujj requested a review 5 days ago
am17an
am17an
am17an approved these changes on 2026-11-14
anujj
am17an
anujj
gaugarg-nv
gaugarg-nv approved these changes on 2026-11-17
JohannesGaessler
JohannesGaessler approved these changes on 2026-11-17
anujj
anujj anujj merged 8777c0c8 into master 1 day ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone