vllm
94ed0bf4 - [Bugfix][KV Offloading] Handle queued request aborts without allocated KV blocks (#49146)
Commit
View On GitHub
Commit
60 days ago
[Bugfix][KV Offloading] Handle queued request aborts without allocated KV blocks (#49146) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Author
chaunceyjiang chaunceyjiang
Parents
1940c844
FAQ Terms Privacy Refunds Impressum
Loading