vllm
add enqueue all option to throughput benchmark
#42975
Merged

add enqueue all option to throughput benchmark #42975

pmaybank
pmaybank add enqueue all option to throughput benchmark
6a95e948
pmaybank pmaybank requested a review from DarkLight1337 DarkLight1337 17 days ago
pmaybank pmaybank requested a review from robertgshaw2-redhat robertgshaw2-redhat 17 days ago
pmaybank pmaybank requested a review from aarnphm aarnphm 17 days ago
pmaybank pmaybank requested a review from NickLucche NickLucche 17 days ago
mergify mergify added frontend
mergify mergify added performance
gemini-code-assist
gemini-code-assist commented on 2026-05-18
pmaybank Update vllm/entrypoints/llm.py
959ba90e
DarkLight1337
DarkLight1337 commented on 2026-05-19
pmaybank extend new flag to completion backend
ea52a92e
DarkLight1337
DarkLight1337 approved these changes on 2026-05-19
DarkLight1337 DarkLight1337 added ready
mergify[bot] Merge branch 'main' into codex/chat-prequeue-benchmark
e8f3d1e2
DarkLight1337 DarkLight1337 enabled auto-merge (squash) 15 days ago
pmaybank
mergify
pmaybank fix error from CI - undefined variable
d467be41
disabled auto-merge 15 days ago
Head branch was pushed to by a user without write access
vllm-bot vllm-bot merged fadf5d33 into main 15 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone