llama.cpp
bench: make n_batch and n_ubatch configurable in Batched bench
#6500
Merged
Overview
Commits
2
Changes
View On GitHub

bench: make n_batch and n_ubatch configurable in Batched bench #6500

ggerganov merged 2 commits into ggml-org:master from Sunt-ing:batched_bench
Sunt-ing
Sunt-ing bench: make n_batch and n_ubatch configurable
fa4802f9
Sunt-ing bench: update doc for batched bench
0b1ef49f
ggerganov
ggerganov approved these changes on 2024-04-05
ggerganov ggerganov merged 87e21bba into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum