llama.cpp
HIP: Use mmq on MFMA devices for MUL_MAT_ID in cases where a lot of splits would be generated
#18202
Merged

HIP: Use mmq on MFMA devices for MUL_MAT_ID in cases where a lot of splits would be generated #18202

IMbackK
IMbackK IMbackK requested a review from JohannesGaessler JohannesGaessler 35 days ago
github-actions github-actions added Nvidia GPU
github-actions github-actions added ggml
JohannesGaessler
JohannesGaessler commented on 2025-12-22
IMbackK HIP: Use mmq on MFMA devices for MUL_MAT_ID in cases where a lot of s…
ed4c3885
IMbackK IMbackK force pushed from 7b05bd2a to ed4c3885 25 days ago
JohannesGaessler
JohannesGaessler approved these changes on 2025-12-28
JohannesGaessler JohannesGaessler merged 4ffc47cb into master 25 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone