text-generation-inference
02e4b9ab
- backend(vllm): plug in the tokio server and CLI
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
329 days ago
backend(vllm): plug in the tokio server and CLI
References
#2976 - [Backend] Introduce vLLM backend
Author
mfuntowicz
Parents
bd2ec03d
Loading