vllm
0a31372e
- [Frontend] Add detokenization streaming derender for disaggregated serving (#47301)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
59 days ago
[Frontend] Add detokenization streaming derender for disaggregated serving (#47301) Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
References
#47301 - [Frontend] Add detokenization streaming derender for disaggregated serving
Author
hickeyma
Parents
451227cb
Loading