llama.cpp
opencl: initial support for iq2
#31267
Merged
Overview
Commits
15
Changes
View On GitHub

opencl: initial support for iq2 #31267

ggerganov merged 15 commits into ggml-org:master from qualcomm:lh/iq2-s
lhez
lhez opencl: add iq2_s AOS mv
0dd635f1
lhez opencl: add iq2_s SOA mv and tiled mm
fb7f51af
lhez opencl: add iq2_s noshuffle gemm/gemv for adreno
c64eff55
lhez opencl: add iq2_s dp4a for adreno
b1c88a94
lhez opencl: optimize iq2_s adreno decode and narrow batches
184af738
lhez opencl: add iq2_xs AOS mv
f60e2f5d
lhez opencl: add iq2_xs SOA mv and tiled mm
aa0727fb
lhez opencl: add iq2_xs noshuffle gemm/gemv for adreno
39476797
lhez opencl: add iq2_xs dp4a for adreno
69cec982
lhez opencl: optimize iq2_xs adreno decode and narrow batches
753ca364
lhez opencl: add iq2_xxs AOS mv
b3f4c4f1
lhez opencl: add iq2_xxs SOA mv and tiled mm
ec364127
lhez opencl: add iq2_xxs noshuffle gemm/gemv for adreno
acef5d26
lhez opencl: add iq2_xxs dp4a for adreno
99028e6c
lhez opencl: optimize iq2_xxs adreno decode and narrow batches
28024055
github-actions github-actions added ggml
github-actions github-actions added OpenCL
lhez lhez marked this pull request as ready for review 16 days ago
lhez lhez requested a review 16 days ago
lhez
lhez lhez added merge ready
max-krasnyansky
max-krasnyansky approved these changes on 2026-10-28
ggerganov ggerganov merged 22183e51 into master 15 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ggml merge ready OpenCL
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum