llama.cpp
opencl: tune the quant paths for Intel Xe-LP GPUs to improve its TG and PP performance
#26438
Merged

opencl: tune the quant paths for Intel Xe-LP GPUs to improve its TG and PP performance #26438

wanghqc
github-actions github-actions added ggml
github-actions github-actions added OpenCL
wanghqc wanghqc force pushed 73 days ago
wanghqc wanghqc force pushed to 5665bffc 59 days ago
wanghqc opencl: Q4_K/Q5_K mul_mv N_DST 4->8 on Intel for 2x activation reuse
d87f431e
wanghqc opencl: Q4_K mul_mm 8x8 tile fot Intel
df11be2b
wanghqc opencl: Q5_K mul_mm 8x8 tile for Intel
2fee355a
wanghqc opencl: Q4_K mul_mv N_DST 8->16 for Intel
b0e0fd19
lhez lhez force pushed from 5665bffc to b0e0fd19 51 days ago
lhez
lhez approved these changes on 2026-08-30
lhez lhez marked this pull request as ready for review 51 days ago
lhez lhez requested a review 51 days ago
lhez lhez requested a review from max-krasnyansky max-krasnyansky 51 days ago
max-krasnyansky
max-krasnyansky approved these changes on 2026-08-30
lhez lhez merged 010be968 into master 51 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone