llama.cpp
925e1179 - llama: add token ID tracking to KV cell (#27762)

Commit

1 day ago

llama: add token ID tracking to KV cell (#27762) * kv: track token id * rm get_prev_tokens, move it to the main pr * nits * add get_prev_tokens

References

Author

ngxson

Parents