llama.cpp
llama-bench : Add `--override-tensors` arg
#12922
Merged

llama-bench : Add `--override-tensors` arg #12922

4onen
4onen Add --override-tensors option to llama-bench
d3f5a582
github-actions github-actions added examples
4onen
4onen 4onen changed the title Add `--override-tensors` option to llama-bench llama-bench : Add `--override-tensors` arg 1 year ago
4onen
4onen
ddh0
slaren
slaren commented on 2025-04-15
4onen
4onen Correct llama-bench --override-tensors to --override-tensor
c326b626
slaren
4onen llama-bench: Update --override-tensors parsing to match --tensor-spli…
833d11ea
4onen
4onen
4onen Make new llama-bench util functions static to fix Ubuntu CI
405224a5
4onen
4onen Merge branch 'master' into llama-bench-tensor-override
a35f5010
4onen
slaren
4onen
4onen
slaren
jukofyork
slaren
slaren requested changes on 2025-04-21
4onen llama-bench: Correct -ot corner cases (No -ot calls, leading and trai…
d2cdd957
slaren
slaren approved these changes on 2025-04-27
slaren slaren merged c0a97b76 into master 1 year ago
4onen 4onen deleted the llama-bench-tensor-override branch 1 year ago
jklincn
4onen

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone