llama.cpp
ggml-cpu: add RVV vec dot kernels for quantization types
#18859
Open

ggml-cpu: add RVV vec dot kernels for quantization types #18859

rehan-10xengineer
taimur-10x ggml-cpu: add rvv quantize_row_q8_K kernel
35143b66
taimur-10x ggml-cpu: add rvv vec_dot for iq4_nl, mxfp4, iq2_xxs
4fa95f1a
taimur-10x ggml-cpu: add rvv vec_dot for iq4_xs, refactor
9abcbe15
taimur-10x ggml-cpu: remove ifunc for rvv vec dot
7ecc5b49
RehanQasim-dev ggml-cpu: add vec_dot for iq2_xs, iq3_xxs
da7da024
rehan-10xengineer rehan-10xengineer requested a review from ggerganov ggerganov 4 days ago
rehan-10xengineer rehan-10xengineer changed the title 10x/riscv quant ggml-cpu: add RVV vec dot kernels for quantization types 4 days ago
github-actions github-actions added ggml

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone