llama.cpp
opencl: allow loading precompiled binary kernels from library
#23042

Merged

opencl: allow loading precompiled binary kernels from library #23042

max-krasnyansky merged 12 commits into ggml-org:master from qualcomm:lh/bin-kernels

github-actions added ggml

github-actions added OpenCL

lhez force pushed 79 days ago

lhez force pushed 72 days ago

opencl: allow loading binary kernel

a959dcb1

opencl: add libdl.h

c4471a20

opencl: allow loading bin kernel lib

639f986e

opencl: load `gemm_moe_mxfp4_f32_ns` from kernel lib if available

f0a438f8

opencl: load q8_0 gemm from kernel lib

dd8f70b2

opencl: load q4_0 moe gemm from kernel lib

c2ceac9e

opencl: load q4_1 moe gemm from kernel lib

6442fa9b

opencl: load q4_k moe gemm from kernel lib

68be2710

opencl: always declare `get_adreno_bin_kernel_func_t`

8fa80969

opencl: rephrase message

0eca49d4

opencl: fix for rebase

2368ddef

lhez force pushed to 2368ddef 67 days ago

lhez marked this pull request as ready for review 67 days ago

lhez requested a review 67 days ago

lhez requested a review from

ggerganov 67 days ago

lhez requested a review from

CISC 67 days ago

CISC approved these changes on 2026-07-01

opencl: update doc

afd4f8dd

github-actions added documentation

max-krasnyansky approved these changes on 2026-07-01

max-krasnyansky merged 4fc4ec55 into master 66 days ago

Reviewers

max-krasnyansky

CISC

ggerganov

Assignees

No one assigned

Labels

documentation ggml OpenCL

Milestone

No milestone

llama.cpp opencl: allow loading precompiled binary kernels from library #23042 Merged

opencl: allow loading precompiled binary kernels from library #23042

llama.cpp
opencl: allow loading precompiled binary kernels from library
#23042

Merged