llama.cpp
4b77dee0 - opencl: add q6_k multi column tiled GEMV for speculative verification and refactoring (#31758)

Commit
2 days ago
opencl: add q6_k multi column tiled GEMV for speculative verification and refactoring (#31758) * opencl: use the multi-column q6_K vocab head GEMV for 2..4 tokens on X2E Co-authored-by: Shangqing Gu <shawngu@qti.qualcomm.com> Assisted-by: Claude Opus 5.5 * opencl: rename GGML_OPENCL_Q6K_MC3 to GGML_OPENCL_Q6_K_MC3 Co-authored-by: Shangqing Gu <shawngu@qti.qualcomm.com> Assisted-by: Claude Opus 5.5 * opencl: rename GGML_OPENCL_Q40/Q41/Q4K_MC3 to GGML_OPENCL_Q4_0/Q4_1/Q4_K_MC3 GGML_OPENCL_Q4K_MC3_DQ and GGML_OPENCL_Q4K_MC3_LDS become GGML_OPENCL_Q4_K_MC3_DQ and GGML_OPENCL_Q4_K_MC3_LDS. Co-authored-by: Shangqing Gu <shawngu@qti.qualcomm.com> Assisted-by: Claude Opus 5.5 * opencl: remove unnecessary debug probe Co-authored-by: Shangqing Gu <shawngu@qti.qualcomm.com> Assisted-by: Claude Opus 5.5 * opencl: clean up --------- Co-authored-by: Li He <lih@qti.qualcomm.com>
Author
Parents
Loading