vllm
refine `vllm bench throughput --backend hf`
#35971

Merged

Commits

refine vllm bench throughput --backend hf

jikunshang committed 154 days ago
use device

jikunshang committed 154 days ago
use current_platform

jikunshang committed 154 days ago
Merge branch 'main' into kunshang/bench_throughput

jikunshang committed 152 days ago

Loading