llama.cpp
opencl: add tiled q4_k GEMM for adreno
#30412
Merged

opencl: add tiled q4_k GEMM for adreno #30412

wanghqc
github-actions github-actions added ggml
github-actions github-actions added OpenCL
wanghqc opencl: run the tiled q4_K lm_head through a tiled GEMM at batch > 1
b852cd8a
wanghqc wanghqc force pushed from cd1a64b4 to b852cd8a 31 days ago
lhez lhez marked this pull request as ready for review 25 days ago
lhez lhez requested a review 25 days ago
max-krasnyansky
max-krasnyansky approved these changes on 2026-10-27
lhez opencl: split tiled dp4a q4_k gemm into its own file and test for dp4a
aeb1a099
lhez lhez changed the title opencl: run the tiled q4_K lm_head through a tiled GEMM at batch > 1 (bug fix) opencl: add tiled q4_k GEMM for adreno (bug fix) 25 days ago
lhez lhez changed the title opencl: add tiled q4_k GEMM for adreno (bug fix) opencl: add tiled q4_k GEMM for adreno 25 days ago
lhez
lhez approved these changes on 2026-10-28
lhez
max-krasnyansky
max-krasnyansky approved these changes on 2026-10-28
lhez lhez merged 74a4fb00 into master 24 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone