llama.cpp
c5a3bc39 - opencl: Adreno optimization for MoE - MxFP4 (#22301)

Commit
85 days ago
opencl: Adreno optimization for MoE - MxFP4 (#22301) * MoE Mxfp4 CLC kernel added, router reorder on GPU * Pass test-backend-ops for MoE mxfp4 Adreno CLC * remove putenv in llama-model.cpp * fix indent style and whitespace * opencl: remove unnecessary headers * opencl: do not save cl_program objects * opencl: remove unnecessary assert * fix precision issue --------- Co-authored-by: Li He <lih@qti.qualcomm.com>
Author
Parents
Loading