llama.cpp
ggml-cpu: use AVX-512 VNNI+VBMI in the Q4_K 8x8 repack GEMM
#29397

Open

ggml-cpu: use AVX-512 VNNI+VBMI in the Q4_K 8x8 repack GEMM #29397

JeremiahM37 wants to merge 1 commit into ggml-org:master from JeremiahM37:cpu-q4k-avx512-vnni-gemm

ggml-cpu: use AVX-512 VNNI+VBMI in the Q4_K 8x8 repack GEMM

51073eff

JeremiahM37 requested a review from

ggerganov 1 day ago

ggml-gh-bot added draft

github-actions added ggml

github-actions marked this pull request as draft 1 day ago

github-actions removed draft

Reviewers

ggerganov

Assignees

No one assigned

Labels

ggml

Milestone

No milestone