llama.cpp
CUDA: fuse shared experts into MMVQ
#29184
Merged

CUDA: fuse shared experts into MMVQ #29184

ggerganov merged 3 commits into master from aman/shared-exp-fusion
am17an
am17an am17an requested a review from ggerganov ggerganov 22 days ago
am17an am17an requested a review 22 days ago
github-actions github-actions added testing
github-actions github-actions added ggml
github-actions github-actions added CUDA
ynankani
ynankani commented on 2026-09-21
JohannesGaessler
JohannesGaessler commented on 2026-09-29
JohannesGaessler
JohannesGaessler approved these changes on 2026-10-01
am17an am17an added merge ready
ggerganov
am17an CUDA: fuse shared experts into MMVQ
2d3b7560
am17an check if buffer is null
7a60a17d
am17an move stride_col_dst to fusion args
7a080b9d
am17an am17an force pushed from e12b6832 to 7a080b9d 10 days ago
ggerganov ggerganov merged bed0a856 into master 10 days ago
ggerganov ggerganov deleted the aman/shared-exp-fusion branch 10 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone