vllm
5ecad9d0
- Submit HiSparse spills after each forward
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
9 days ago
Submit HiSparse spills after each forward Co-authored-by: OpenAI Codex <noreply@openai.com> Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
References
#53781 - [3/N] HiSparse: host-resident sparse-MLA decode hot-buffering
#55969 - [KV Connector] Generalize declarative connector stats (TypedKVConnectorStats)
Author
MatthewBonanni
Committer
MatthewBonanni
Parents
c4402b86
Loading
