text-generation-inference
460f290d
- effectively cancel the request on the executor
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
effectively cancel the request on the executor
References
#2791 - TensorRT-LLM backend bump to latest version + misc fixes
Author
mfuntowicz
Parents
b6dbf605
Loading