PR #18537 mmq.cu: tune mmq/rocblas switching for RDNA

mmq.cu: tune mmq/rocblas switching for RDNA #18537

JohannesGaessler merged 5 commits into ggml-org:master from Beinsezii:beinsezii/rocm_mmq_tune

Patch perf regression for mmq kernels in ROCm

51e3d385

add n_experts branch like the cdna path

69a9a68b

mmq.cu: tune mmq/wmma switching for RDNA

a435c772

Beinsezii requested a review from

JohannesGaessler 26 days ago

Beinsezii commented on 2026-01-02

github-actions added Nvidia GPU

github-actions added ggml

Beinsezii changed the title ~~mmq.cu: tune mmq/wmma switching for RDNA~~ mmq.cu: tune mmq/rocblas switching for RDNA 26 days ago

JohannesGaessler commented on 2026-01-02

IMbackK approved these changes on 2026-01-02

mmq.cu: move amd wmma mmq/wmma switching behind IS_RDNA3

3326fa23

JohannesGaessler commented on 2026-01-02

Update ggml/src/ggml-cuda/mmq.cu

3fef966d

JohannesGaessler approved these changes on 2026-01-06

JohannesGaessler merged 96892952 into master 22 days ago

Beinsezii deleted the beinsezii/rocm_mmq_tune branch 22 days ago

Reviewers

JohannesGaessler

IMbackK

Assignees

No one assigned

Labels

Nvidia GPU ggml

Milestone

No milestone