text-generation-inference
bd2ec03d - backend(vllm): statically allocate LLMEngine
Commit
View On GitHub
Commit
1 year ago
backend(vllm): statically allocate LLMEngine
Author
mfuntowicz mfuntowicz
Parents
cfd22726
FAQ Terms Privacy Refunds Impressum
Loading