opencl: initial support for iq2 (#31267)
* opencl: add iq2_s AOS mv
* opencl: add iq2_s SOA mv and tiled mm
* opencl: add iq2_s noshuffle gemm/gemv for adreno
* opencl: add iq2_s dp4a for adreno
* opencl: optimize iq2_s adreno decode and narrow batches
Co-authored-by: Hongqiang Wang <wangh@qti.qualcomm.com>
* opencl: add iq2_xs AOS mv
* opencl: add iq2_xs SOA mv and tiled mm
* opencl: add iq2_xs noshuffle gemm/gemv for adreno
* opencl: add iq2_xs dp4a for adreno
* opencl: optimize iq2_xs adreno decode and narrow batches
Co-authored-by: Hongqiang Wang <wangh@qti.qualcomm.com>
* opencl: add iq2_xxs AOS mv
* opencl: add iq2_xxs SOA mv and tiled mm
* opencl: add iq2_xxs noshuffle gemm/gemv for adreno
* opencl: add iq2_xxs dp4a for adreno
* opencl: optimize iq2_xxs adreno decode and narrow batches
Co-authored-by: Hongqiang Wang <wangh@qti.qualcomm.com>
---------
Co-authored-by: Hongqiang Wang <wangh@qti.qualcomm.com>
