PR #6468 server: add option to disable KV offload

server: add option to disable KV offload #6468

ggerganov merged 1 commit into ggml-org:master from jxy:server-nkvo

server: add option to disable KV offload

ecef370e

slaren approved these changes on 2024-04-04

ggerganov merged 1a43c725 into master 1 year ago

jxy deleted the server-nkvo branch 1 year ago

Reviewers

slaren

Assignees

No one assigned

Labels

None yet

Milestone

No milestone