llama.cpp
llama: add token ID tracking to KV cell
#27762
Merged

llama: add token ID tracking to KV cell #27762

ngxson merged 4 commits into master from xsn/kv_track_token_id
ngxson
ngxson kv: track token id
980256bd
ngxson rm get_prev_tokens, move it to the main pr
c0ea2b30
ngxson nits
d07a0ae3
ngxson ngxson requested a review from ggerganov ggerganov 4 days ago
ngxson ngxson changed the title Xsn/kv track token llama: add token ID tracking to KV cell 4 days ago
ggerganov ggerganov assigned ggerganov ggerganov 4 days ago
ggerganov
ggerganov approved these changes on 2026-08-26
ngxson add get_prev_tokens
2bd70781
ggerganov
ggerganov commented on 2026-08-26
ngxson ngxson merged 925e1179 into master 4 days ago
spb5030
spb5030 commented on 2026-08-27
ngxson

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone