vllm

10904e6d - [benchmark] Port benchmark request sent optimization to benchmark_serving (#21209)