vllm
[Feature] default --extra-body param to disable thinking in vllm bench serve
#26784

Merged

[Feature] default --extra-body param to disable thinking in vllm bench serve #26784

DarkLight1337 merged 5 commits into vllm-project:main from lengrongfu:feat/opt-bench

[Feature] default disable thinking in vllm bench serve

0fc83881

mergify added performance

gemini-code-assist commented on 2025-10-14

DarkLight1337 commented on 2025-10-14

lengrongfu requested a review from

aarnphm 207 days ago

lengrongfu requested a review from

chaunceyjiang 207 days ago

mergify added frontend

add --extra-body pararm to cli

500bc660

lengrongfu force pushed to 500bc660 207 days ago

lengrongfu changed the title ~~[Feature] default disable thinking in vllm bench serve~~ [Feature] default --extra-body param to disable thinking in vllm bench serve 207 days ago

DarkLight1337 commented on 2025-10-14

still call this sampling_params

d4c9ecd7

DarkLight1337 commented on 2025-10-14

still call this sampling_params

12ceb67e

lengrongfu force pushed to 12ceb67e 207 days ago

DarkLight1337 approved these changes on 2025-10-14

DarkLight1337 enabled auto-merge (squash) 207 days ago

github-actions added ready

Merge branch 'main' into feat/opt-bench

47be1175

DarkLight1337 merged a27b288e into main 207 days ago

lengrongfu deleted the feat/opt-bench branch 201 days ago

Reviewers

DarkLight1337

gemini-code-assist

aarnphm

chaunceyjiang

Assignees

No one assigned

Labels

performance frontend ready

Milestone

No milestone

vllm [Feature] default --extra-body param to disable thinking in vllm bench serve #26784 Merged

[Feature] default --extra-body param to disable thinking in vllm bench serve #26784

vllm
[Feature] default --extra-body param to disable thinking in vllm bench serve
#26784

Merged