vllm
[Benchmark] Add sampling parameters to benchmark_serving.
#16022

Merged

[Benchmark] Add sampling parameters to benchmark_serving. #16022

DarkLight1337 merged 4 commits into vllm-project:main from hyeygit:bench_serving_no_base

Add sampling parameters to benchmark_serving.

a436d328

hyeygit changed the title ~~Add sampling parameters to benchmark_serving.~~ [Benchmark] Add sampling parameters to benchmark_serving. 1 year ago

hyeygit closed this 1 year ago

hyeygit reopened this 1 year ago

simon-mo requested a review from

ywang96 1 year ago

ywang96 commented on 2025-04-03

NickLucche requested changes on 2025-04-04

Address review feedback

e0b8be16

Add sampling example to README

aafb8276

mergify added needs-rebase

Merge branch 'main' into bench_serving_no_base

c206a303

mergify removed needs-rebase

ywang96 approved these changes on 2025-04-05

ywang96 added ready

DarkLight1337 merged ba108019 into main 1 year ago

Reviewers

ywang96

NickLucche

Assignees

No one assigned

Labels

ready

Milestone

No milestone