text-generation-inference
003163a2
- backend(vllm): map ResultOutput to InferStreamResponse to stream back to the client
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
backend(vllm): map ResultOutput to InferStreamResponse to stream back to the client
Author
mfuntowicz
Parents
32dffcff
Loading