vllm
9fe98d42
- [Frontend] Add request_id to the Request object so they can be controlled better via external load balancers (#21009)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
213 days ago
[Frontend] Add request_id to the Request object so they can be controlled better via external load balancers (#21009) Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
References
#21009 - [Frontend] Add request_id to the Request object so they can be controlled better via external load balancers
Author
kouroshHakha
Parents
29c6fbe5
Loading