text-generation-inference
benchmark: fix prefill throughput
#2741
Merged

benchmark: fix prefill throughput #2741

Narsil merged 1 commit into main from bench-prefill-throughput
danieldk
danieldk benchmark: fix prefill throughput
d6c8426b
Narsil
Narsil approved these changes on 2024-11-15
Narsil Narsil merged 8442f1ac into main 1 year ago
Narsil Narsil deleted the bench-prefill-throughput branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone