vllm
5ea267a2
- Make KV connector step lifecycle explicit
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
12 days ago
Make KV connector step lifecycle explicit Co-authored-by: Codex <codex@openai.com> Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
References
#51323 - [1/N] HiSparse: host-resident sparse-MLA decode hot-buffering
#51335 - [2/N] Expose HiSparse cache metrics
Author
MatthewBonanni
Parents
4a23f3f2
Loading