vllm
[Frontend] Add detokenization streaming derender for disaggregated serving
#47301
Merged
Merged
[Frontend] Add detokenization streaming derender for disaggregated serving #47301
ywang96
merged
5 commits into
vllm-project:main
from
hickeyma:add-stream-detoekn-derender
claude
commented
on 2026-07-01
bongwoobak
commented
on 2026-07-08
bongwoobak
commented
on 2026-07-11
bongwoobak
approved these changes
on 2026-07-17
[Frontend] Add detokenization streaming derender for disaggregated se…
aaa39b8b
fix: use generate chunk's prompt_tokens as fallback in stream derender
5f185c13
Update review comments
c6eceb38
fix: Harden stream_state handling in derender streaming path
55776b9b
Pass completion_request through to _derender_completion
ac4d578b
sagearc
approved these changes
on 2026-07-29
ywang96
approved these changes
on 2026-07-30
Reviewers
Assignees
No one assigned
Labels
frontend
ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub