PR #25070 server: add strict prompt cache RAM limit

server: add strict prompt cache RAM limit #25070

ngxson merged 1 commit into ggml-org:master from tarruda:cache-ram-strict

tarruda requested a review 122 days ago

github-actions added server

tarruda force pushed 121 days ago

tarruda force pushed 113 days ago

tarruda force pushed 112 days ago

server: enforce prompt cache RAM limit

13c21c05

tarruda force pushed to 13c21c05 112 days ago

ggerganov approved these changes on 2026-07-07

pwilkin approved these changes on 2026-07-07

ngxson approved these changes on 2026-07-07

ngxson merged 6c487e2f into master 112 days ago

tarruda deleted the cache-ram-strict branch 112 days ago

sanmai commented on 2026-10-14

Reviewers

ngxson

pwilkin

ggerganov

sanmai

Assignees

No one assigned

Labels

server

Milestone

No milestone