vllm
[Bug] [V1] Try fetching stop_reason from EngineOutput before checking the request
#13108

Merged

[Bug] [V1] Try fetching stop_reason from EngineOutput before checking the request #13108

simon-mo merged 2 commits into vllm-project:main from neuralmagic:fix-stop-reason

bnellnm requested a review from

WoosukKwon 1 year ago

bnellnm requested a review from

robertgshaw2-redhat 1 year ago

bnellnm requested a review from

njhill 1 year ago

bnellnm requested a review from

ywang96 1 year ago

bnellnm requested a review from

comaniac 1 year ago

bnellnm requested a review from

alexm-redhat 1 year ago

bnellnm changed the title ~~Try fetching stop_reason from EngineOutput before checking the request~~ [Bug] [V1] Try fetching stop_reason from EngineOutput before checking the request 1 year ago

mergify added v1

njhill assigned

njhill 1 year ago

Try fetching stop_reason from EngineOutput before checking the request

b80a1b60

bnellnm force pushed to b80a1b60 1 year ago

njhill approved these changes on 2025-02-11

review comment, fix type annotation

89bad073

njhill approved these changes on 2025-02-11

njhill added ready

DarkLight1337 enabled auto-merge (squash) 1 year ago

disabled auto-merge 1 year ago
Manually disabled by user

simon-mo merged f4d97e4f into main 1 year ago

bnellnm deleted the fix-stop-reason branch 240 days ago

Reviewers

njhill

WoosukKwon

robertgshaw2-redhat

ywang96

comaniac

alexm-redhat

Assignees

njhill

Labels

ready v1

Milestone

No milestone

vllm [Bug] [V1] Try fetching stop_reason from EngineOutput before checking the request #13108 Merged

[Bug] [V1] Try fetching stop_reason from EngineOutput before checking the request #13108

vllm
[Bug] [V1] Try fetching stop_reason from EngineOutput before checking the request
#13108

Merged