llama.cpp
Small (and unreliable) AVX2 ggml_vec_dot_q4_K_q8_K improvement - remove instruction dependency
#2819
Merged
Merged
Small (and unreliable) AVX2 ggml_vec_dot_q4_K_q8_K improvement - remove instruction dependency #2819
ggerganov
merged
1 commit into
ggml-org:master
from
ronnyb/avx-vec-dot-optimizatin
hydroo
changed the title
ggerganov
approved these changes
on 2023-08-26
improve ggml_vec_dot_q4_K_q8_K AVX2 10% by reducing instruction depen…
ff830174
Karocyt
approved these changes
on 2023-08-27
hydroo
changed the title
Login to write a write a comment.
Login via GitHub