PR #25325 llama_dsv4: write only used rows in state

llama_dsv4: write only used rows in state #25325

am17an merged 2 commits into ggml-org:master from am17an:dsv4-cache

am17an requested a review from

ggerganov 132 days ago

ggerganov commented on 2026-07-06

am17an requested a review from

CISC 132 days ago

am17an force pushed 132 days ago

llama_dsv4: write only used rows in state

4b742ccb

add TODO about conflating token pos with kv rows

1fc9b63e

am17an force pushed to 1fc9b63e 118 days ago

fairydreaming approved these changes on 2026-07-20

ruixiang63 approved these changes on 2026-07-20

am17an merged 91d2fc38 into master 117 days ago

Reviewers

ruixiang63

fairydreaming

ggerganov

CISC

Assignees

No one assigned

Labels

None yet

Milestone

No milestone