vllm
3cc328a4 - [SpecDecode][Benchmark] Add SPEED-bench support to benchmarking CLI (#36029)

Commit

15 days ago

[SpecDecode][Benchmark] Add SPEED-bench support to benchmarking CLI (#36029) Signed-off-by: talora <talora@nvidia.com> Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

References

#36029 - [SpecDecode][Benchmark] Add SPEED-bench support to benchmarking CLI

Author

talorabr

Parents

3beb57a2

vllm 3cc328a4 - [SpecDecode][Benchmark] Add SPEED-bench support to benchmarking CLI (#36029)

vllm
3cc328a4 - [SpecDecode][Benchmark] Add SPEED-bench support to benchmarking CLI (#36029)