llama.cpp
CUDA: enroll mul_mat_vec_q_moe into pdl
#24087
Merged

CUDA: enroll mul_mat_vec_q_moe into pdl #24087

ORippler
ORippler Enroll mul_mat_vec_q_moe into PDL, boosting MTP performance on BW
770a38f5
ORippler LC to overlap with following kernels
b508845c
ORippler ORippler requested a review 44 days ago
github-actions github-actions added Nvidia GPU
github-actions github-actions added ggml
JohannesGaessler
JohannesGaessler approved these changes on 2026-06-04
am17an
am17an approved these changes on 2026-06-05
JohannesGaessler JohannesGaessler merged 2154a0fd into master 43 days ago
ORippler ORippler deleted the osimons/enroll_mul_mat_vec_q_moe_into_PDL branch 40 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone