llama.cpp
b28a2f37 - opencl: add MoE support for q4_k, q5_k, q6_k on Adreno (#23303)

Commit
63 days ago
opencl: add MoE support for q4_k, q5_k, q6_k on Adreno (#23303) * opencl: add q4_k moe support * opencl: add q5_k moe support * opencl: add q6_k moe support * opencl: adjust format --------- Co-authored-by: Li He <lih@qti.qualcomm.com>
Author
Parents
Loading