llama.cpp
010be968 - opencl: tune the quant paths for Intel Xe-LP GPUs to improve its TG and PP performance (#26438)

Commit
1 day ago
opencl: tune the quant paths for Intel Xe-LP GPUs to improve its TG and PP performance (#26438) * opencl: Q4_K/Q5_K mul_mv N_DST 4->8 on Intel for 2x activation reuse * opencl: Q4_K mul_mm 8x8 tile fot Intel * opencl: Q5_K mul_mm 8x8 tile for Intel * opencl: Q4_K mul_mv N_DST 8->16 for Intel
Author
Parents
Loading