server : enable KV cache defrag by default #10233
server : enable KV cache defrag by default
014eb6f2
danbev
approved these changes
on 2024-11-09
ggerganov
merged
b141e5f6
into master 333 days ago
ggerganov
deleted the gg/common-enable-defrag branch 333 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub