llama.cpp
llama_dsv4: write only used rows in state
#25325
Open

llama_dsv4: write only used rows in state #25325

am17an wants to merge 2 commits into ggml-org:master from am17an:dsv4-cache
am17an
am17an llama_dsv4: write only used rows in state
e1a7a5a8
am17an am17an requested a review from ggerganov ggerganov 3 days ago
ggerganov
ggerganov commented on 2026-07-06
am17an am17an requested a review from CISC CISC 2 days ago
am17an am17an force pushed from 2e6f53c6 to f4141ee3 2 days ago
am17an add TODO about conflating token pos with kv rows
4f30071f
am17an am17an force pushed from f4141ee3 to 4f30071f 2 days ago
ggerganov

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone