k_quants : add AVX support to dot functions with QK_K as 64 #2339
ggerganov
merged
6 commits into
ggml-org:master
from
katsu560:add-avx-qkk64
add AVX to ggml_vec_dot_q2_K_q8_K()
6afbb11c
add AVX to ggml_vec_dot_q3_K_q8_K()
2024d40a
add AVX to ggml_vec_dot_q4_K_q8_K()
56df218f
add AVX to ggml_vec_dot_q5_K_q8_K()
dfd2e0e5
add AVX to ggml_vec_dot_q6_K_q8_K()
4775602c
refactor AVX code in ggml_vec_dot_q6_K_q8_K()
5f98fc2f
ikawrakow
approved these changes
on 2023-07-24
Login to write a write a comment.
Login via GitHub