llama.cpp
b28a2f37
- opencl: add MoE support for q4_k, q5_k, q6_k on Adreno (#23303)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
63 days ago
opencl: add MoE support for q4_k, q5_k, q6_k on Adreno (#23303) * opencl: add q4_k moe support * opencl: add q5_k moe support * opencl: add q6_k moe support * opencl: adjust format --------- Co-authored-by: Li He <lih@qti.qualcomm.com>
References
#23303 - opencl: add MoE support for q4_k, q5_k, q6_k on Adreno
Author
shaofeiqi
Parents
17d22a35
Loading