vllm
024b06b0
- [Bugfix] Expose usage field in GenerateResponse for disaggregated serving (#42748)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
17 days ago
[Bugfix] Expose usage field in GenerateResponse for disaggregated serving (#42748) Signed-off-by: AIvashov <ivashov.aleksey@proton.me> Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai> Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
References
#42748 - [Bugfix] Expose usage field in GenerateResponse for disaggregated serving
Author
AIvashov
Parents
e7d0fcbc
Loading