llama.cpp
CUDA/HIP: add support for selectable warp size to mmv
#11519
Merged

CUDA/HIP: add support for selectable warp size to mmv #11519

IMbackK merged 2 commits into ggml-org:master from IMbackK:addWarpSize
IMbackK
IMbackK IMbackK requested a review from JohannesGaessler JohannesGaessler 1 year ago
IMbackK IMbackK force pushed to a151674c 1 year ago
IMbackK IMbackK force pushed from a151674c 1 year ago
IMbackK
IMbackK
IMbackK IMbackK force pushed 1 year ago
github-actions github-actions added Nvidia GPU
github-actions github-actions added ggml
IMbackK IMbackK force pushed 1 year ago
IMbackK IMbackK force pushed 1 year ago
Beinsezii
IMbackK
Beinsezii
BlueSwordM
IMbackK
BlueSwordM
IMbackK
JohannesGaessler
JohannesGaessler commented on 2025-02-02
IMbackK CUDA/HIP: add support for selectable warp size to mmv
078ee4ff
IMbackK IMbackK force pushed to 078ee4ff 1 year ago
IMbackK
JohannesGaessler
JohannesGaessler approved these changes on 2025-02-02
IMbackK Update ggml/src/ggml-cuda/common.cuh
182f418b
IMbackK IMbackK merged 396856b4 into master 1 year ago
BodhiHu
IMbackK

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone