llama.cpp
server: fix infinite retry loop when KV cache is full
#20050

Open

server: fix infinite retry loop when KV cache is full #20050

ssam18 wants to merge 2 commits into ggml-org:master from ssam18:fix-kv-cache-retry-loop

server: fix infinite retry loop when KV cache is full

21047571

ssam18 requested a review from

ngxson 2 days ago

ssam18 requested a review from

ggerganov 2 days ago

github-actions added examples

github-actions added server

fix trailing whitespace

de30196b

Reviewers

ngxson

ggerganov

Assignees

No one assigned

Labels

examples server

Milestone

No milestone