vllm
fbb3cf69
- [Bugfix][Async][Connector] avoid vllm-side double free during async scheduling + request abort + async KV cache transfer (#33377)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
83 days ago
[Bugfix][Async][Connector] avoid vllm-side double free during async scheduling + request abort + async KV cache transfer (#33377) Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
References
#33377 - [Bugfix][Async][Connector] avoid vllm-side double free during async scheduling + request abort + async KV cache transfer
Author
KuntaiDu
Parents
2df2b349
Loading