PR #3545 batched : add bench tool

batched : add bench tool

ggerganov committed 2 years ago

batched : minor fix table

ggerganov committed 2 years ago

batched-bench : add readme + n_kv_max is now configurable

ggerganov committed 2 years ago

Merge branch 'master' into batched-bench

ggerganov committed 2 years ago

batched-bench : init warm-up batch

ggerganov committed 2 years ago

batched-bench : pass custom set of PP, TG and PL

ggerganov committed 2 years ago

batched-bench : add mmq CLI arg

ggerganov committed 2 years ago

llama.cpp batched : add bench tool #3545 Merged