PR #23792 TP: quantized KV cache support

TP: quantized KV cache support #23792

JohannesGaessler merged 3 commits into ggml-org:master from JohannesGaessler:tp-quant-kv-3

JohannesGaessler requested a review from

CISC 9 days ago

JohannesGaessler requested a review from

ggerganov 9 days ago

github-actions added ggml

JohannesGaessler force pushed from 2b2d0e2c to 5c26ac50 7 days ago

TP: quantized KV cache support

5c7f3f79

fix partial view

a4304065

remove overly strict assert

ae22953f

JohannesGaessler force pushed from 5c26ac50 to ae22953f 7 days ago

CISC approved these changes on 2026-05-30

ggerganov approved these changes on 2026-06-01

JohannesGaessler merged 8e6fff84 into master 5 days ago

Reviewers

ggerganov

CISC

Assignees

No one assigned

Labels

ggml

Milestone

No milestone