llama.cpp
74a4fb00 - opencl: add tiled q4_k GEMM for adreno (#30412)

Commit
25 days ago
opencl: add tiled q4_k GEMM for adreno (#30412) * opencl: run the tiled q4_K lm_head through a tiled GEMM at batch > 1 * opencl: split tiled dp4a q4_k gemm into its own file and test for dp4a Assisted-by: Codex --------- Co-authored-by: Li He <lih@qti.qualcomm.com>
Author
Parents
Loading