llama.cpp
server : enable KV cache defrag by default
#10233
Merged

server : enable KV cache defrag by default #10233

ggerganov merged 1 commit into master from gg/common-enable-defrag
ggerganov
ggerganov server : enable KV cache defrag by default
014eb6f2
danbev
danbev approved these changes on 2024-11-09
github-actions github-actions added examples
github-actions github-actions added server
ggerganov ggerganov merged b141e5f6 into master 333 days ago
ggerganov ggerganov deleted the gg/common-enable-defrag branch 333 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone