llama-bench : add no-kv-offload parameter #4812
llama-bench : add no-kv-offload parameter
32d9f7d9
ggerganov
approved these changes
on 2024-01-07
slaren
merged
226460cc
into master 1 year ago
slaren
deleted the sl/bench-nkvoffload branch 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub