vllm

[MISC][Bench] refactor throughput and reuse serve's get samples

#50981

Merged