llama.cpp
bench: make n_batch and n_ubatch configurable in Batched bench
#6500

Merged

Commits

bench: make n_batch and n_ubatch configurable

Sunt-ing committed 2 years ago
bench: update doc for batched bench

Sunt-ing committed 2 years ago

Loading