llama.cpp
llama-bench : add no-kv-offload parameter
#4812
Merged

llama-bench : add no-kv-offload parameter #4812

slaren merged 1 commit into master from sl/bench-nkvoffload
slaren
slaren llama-bench : add no-kv-offload parameter
32d9f7d9
ggerganov
ggerganov approved these changes on 2024-01-07
slaren slaren merged 226460cc into master 1 year ago
slaren slaren deleted the sl/bench-nkvoffload branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone