vllm
ba108019 - [Benchmark] Add sampling parameters to benchmark_serving. (#16022)

Commit

257 days ago

[Benchmark] Add sampling parameters to benchmark_serving. (#16022) Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>

References

Author

hyeygit

Parents