vllm
fbb3cf69 - [Bugfix][Async][Connector] avoid vllm-side double free during async scheduling + request abort + async KV cache transfer (#33377)

Commit

83 days ago

[Bugfix][Async][Connector] avoid vllm-side double free during async scheduling + request abort + async KV cache transfer (#33377) Signed-off-by: KuntaiDu <kuntai@uchicago.edu>

References

#33377 - [Bugfix][Async][Connector] avoid vllm-side double free during async scheduling + request abort + async KV cache transfer

Author

KuntaiDu

Parents

2df2b349

vllm fbb3cf69 - [Bugfix][Async][Connector] avoid vllm-side double free during async scheduling + request abort + async KV cache transfer (#33377)

vllm
fbb3cf69 - [Bugfix][Async][Connector] avoid vllm-side double free during async scheduling + request abort + async KV cache transfer (#33377)