llama.cpp
server : make n_cache_reuse configurable per request
#17858

Merged

server : make n_cache_reuse configurable per request #17858

ggerganov merged 1 commit into master from gg/server-cache-reuse-param

server : make cache_reuse configurable per request

09519f71

ggerganov requested a review from

ngxson 176 days ago

ggerganov changed the title ~~server : make cache_reuse configurable per request~~ server : make n_cache_reuse configurable per request 176 days ago

github-actions added examples

github-actions added server

ngxson approved these changes on 2025-12-08

ggerganov merged 2bc96931 into master 176 days ago

ggerganov deleted the gg/server-cache-reuse-param branch 176 days ago

Reviewers

ngxson

Assignees

No one assigned

Labels

examples server

Milestone

No milestone

llama.cpp server : make n_cache_reuse configurable per request #17858 Merged

server : make n_cache_reuse configurable per request #17858

llama.cpp
server : make n_cache_reuse configurable per request
#17858

Merged