llama.cpp
b083c384 - opencl: add initial q2_k support (#30999)

Commit
25 days ago
opencl: add initial q2_k support (#30999) * opencl: add `mul_mv_q2_k_f32` * opencl: add q2_k SOA mv and tiled mm * opencl: add q2_k noshuffle gemm/gemv for adreno * opencl: add q2_k dp4a gemm for adreno Co-authored-by: Hongqiang Wang <wangh@qti.qualcomm.com> * opencl: tune q2_k kernels for adreno --------- Co-authored-by: Hongqiang Wang <wangh@qti.qualcomm.com>
Author
Parents
Loading