llama : refactor kv cache guard #12695
ggerganov
merged
8 commits into
master
from
gg/llama-kv-cache-v4
llama : refactor kv cache guard
f1d179ec
cont : fix comment [no ci]
4fdd6e51
llama : fix kv_cache restore logic
623954b5
context : simplify kv cache updates
5c844887
cont : better name [no ci]
eb5518f0
llama : fix llama_decode return code when could not find KV slot
2c41dffc
context : change log err -> warn [no ci]
8ab37b18
kv-cache : add comment + warning [no ci]
626f822c
Reviewers
No reviews
Assignees
No one assigned
Labels
examples
Milestone
No milestone
Login to write a write a comment.
Login via GitHub