opencl: add several gemm variants for small batches and some fixes #30850
opencl: fix OOB read in `mul_mv_mxfp4_f32_flat`
1918a054
opencl: remove large-N guard that forces CPU weight placement
79e5c003
opencl: cap num of subgroups by workgroup size for q4_0 mc3
c51d44f1
opencl: add small batch variant for q4_k dp4a GEMM
59d22dc1
opencl: add a narrow variant of mul_mm_f16_f32_l4_lm
e1cc117d
opencl: add a one subgroup variant for gemv_noshuffle_q1_0_f32 for big M
43e1f804
lhez
marked this pull request as ready for review 31 days ago
lhez
requested a review
31 days ago
lhez
added merge ready
ggerganov
merged
a01ce9ff
into master 31 days ago
Assignees
No one assigned
Labels
ggml
merge ready
OpenCL
Login to write a write a comment.
Login via GitHub