llama.cpp
ggml-cpu: add RVV vec dot kernels for quantization types
#18859

Merged

ggml-cpu: add RVV vec dot kernels for quantization types #18859

ggerganov merged 6 commits into ggml-org:master from riseproject-dev:10x/riscv-quant

rehan-10xengineer requested a review from

ggerganov 257 days ago

rehan-10xengineer changed the title ~~10x/riscv quant~~ ggml-cpu: add RVV vec dot kernels for quantization types 257 days ago

github-actions added ggml

taimur-10x force pushed from da7da024 245 days ago

taimur-10x force pushed 209 days ago

rehan-10xengineer force pushed 203 days ago

xctan approved these changes on 2026-03-10

rehan-10xengineer force pushed 203 days ago

ggml-cpu: add rvv quantize_row_q8_K kernel

ff3b9b3f

ggml-cpu: add rvv vec_dot for iq4_nl, mxfp4, iq2_xxs

6f7a8632

ggml-cpu: add rvv vec_dot for iq4_xs, refactor

3c419337

ggml-cpu: remove ifunc for rvv vec dot

3b64b0e8

ggml-cpu: add vec_dot for iq2_xs, iq3_xxs

52a2d3a1

ggml-cpu: refactor quants.c

68e3cee4

rehan-10xengineer force pushed to 68e3cee4 200 days ago

ggerganov merged fbaa95bc into master 200 days ago

Reviewers

xctan

ggerganov

Assignees

No one assigned

Labels

ggml

Milestone

No milestone