vllm
[AsyncScheduling] Don't schedule past request max_tokens
#27922

Merged

[AsyncScheduling] Don't schedule past request max_tokens #27922

WoosukKwon merged 7 commits into vllm-project:main from njhill:async-sched-max-toks

njhill requested a review from

WoosukKwon 273 days ago

njhill requested a review from

robertgshaw2-redhat 273 days ago

njhill requested a review from

ywang96 273 days ago

njhill requested a review from

comaniac 273 days ago

njhill requested a review from

alexm-redhat 273 days ago

njhill requested a review from

heheda12345 273 days ago

njhill requested a review from

ApostaC 273 days ago

mergify added v1

gemini-code-assist commented on 2025-11-01

chatgpt-codex-connector commented on 2025-11-01

njhill force pushed 273 days ago

[AsyncScheduling] Don't schedule past request max_tokens

5870224a

njhill force pushed to 5870224a 273 days ago

njhill added ready

WoosukKwon approved these changes on 2025-11-03

add check to test

e370b56a

njhill enabled auto-merge (squash) 271 days ago

disabled auto-merge 271 days ago
Manually disabled by user

WoosukKwon enabled auto-merge (squash) 271 days ago

Merge remote-tracking branch 'refs/remotes/origin/main' into async-sc…

75e426cf

Merge branch 'main' into async-sched-max-toks

7d11eced

fix suffix decoding test

1cebab10

Merge remote-tracking branch 'origin/main' into async-sched-max-toks

8c332b9e

Merge branch 'main' into async-sched-max-toks

d5d17bfe

WoosukKwon merged 938a8169 into main 270 days ago

njhill deleted the async-sched-max-toks branch 270 days ago

Reviewers

WoosukKwon

chatgpt-codex-connector

gemini-code-assist

robertgshaw2-redhat

ywang96

comaniac

alexm-redhat

heheda12345

ApostaC

Assignees

No one assigned

Labels

ready v1

Milestone

No milestone

vllm [AsyncScheduling] Don't schedule past request max_tokens #27922 Merged

[AsyncScheduling] Don't schedule past request max_tokens #27922

vllm
[AsyncScheduling] Don't schedule past request max_tokens
#27922

Merged