llama.cpp
CUDA/HIP: optimize mmv paths taken for HIP/CDNA
#14324
Merged

CUDA/HIP: optimize mmv paths taken for HIP/CDNA #14324

IMbackK merged 4 commits into ggml-org:master from IMbackK:cuda-mmv-bsgt1-9
IMbackK
IMbackK IMbackK requested a review from JohannesGaessler JohannesGaessler 1 year ago
github-actions github-actions added Nvidia GPU
github-actions github-actions added ggml
daniandtheweb
IMbackK
daniandtheweb
IMbackK
IMbackK
daniandtheweb
yeahdongcn
daniandtheweb
JohannesGaessler
IMbackK CUDA/HIP: optimize mmv paths taken for HIP/CDNA
6a414d9e
IMbackK CUDA/HIP: use mmv instead of rocblas for batch 3-5 mmv
66f4c93b
IMbackK IMbackK force pushed to 66f4c93b 1 year ago
IMbackK
JohannesGaessler
JohannesGaessler commented on 2025-06-23
IMbackK Update ggml/src/ggml-cuda/common.cuh
70774e16
JohannesGaessler
JohannesGaessler commented on 2025-06-23
IMbackK restirct to amd
8bd52b67
IMbackK IMbackK force pushed to 8bd52b67 1 year ago
JohannesGaessler
JohannesGaessler approved these changes on 2025-06-23
IMbackK IMbackK merged 0142961a into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone