vllm
46aae4df - Align HiSparse with KV connector lifecycle

Commit
3 days ago
Align HiSparse with KV connector lifecycle Move HiSparse into its own v1 package, split scheduler and worker responsibilities, and carry worker commands through standard connector metadata. Keep ActiveKVConnector generic while preserving the post-forward spill and CUDA graph reset lifecycle. Co-authored-by: OpenAI Codex <codex@openai.com> Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Committer
Parents
Loading