vllm
ba108019 - [Benchmark] Add sampling parameters to benchmark_serving. (#16022)
Commit
View On GitHub
Commit
97 days ago
[Benchmark] Add sampling parameters to benchmark_serving. (#16022) Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
Author
hyeygit hyeygit
Parents
620fc2d0
  • benchmarks
    • File
      README.md
    • File
      backend_request_func.py
    • File
      benchmark_serving.py
FAQ Terms Privacy Refunds Impressum