vllm
[5/N][KV Connector][NIXL] Stage host KV reads through device memory
#53263
Open
Open
[5/N][KV Connector][NIXL] Stage host KV reads through device memory #53263
MatthewBonanni
wants to merge
13 commits into
feat/hisparse-metrics
from
feat/nixl-host-read-staging
claude
commented
on 2026-08-21
MatthewBonanni
changed the title
MatthewBonanni
changed the title
LucasWilkinson
commented
on 2026-08-21
LucasWilkinson
commented
on 2026-08-21
LucasWilkinson
approved these changes
on 2026-08-24
MatthewBonanni
changed the title
iyastreb
requested changes
on 2026-08-26
tvegas1
commented
on 2026-08-26
brminich
requested changes
on 2026-08-26
[KV Connector] Stage host-memory KV reads through device memory
c854d382
Harden NIXL host-staging lifecycle
05816a6b
Rename host read stager for destination semantics
95a05688
Let host stager own its shutdown lifecycle
4525a7ae
Remove implementation-mirroring shutdown test
0a1d27ad
Relax NIXL shutdown executor assertion
5eaead83
[NIXL] Simplify host-stager progress and shutdown (#53354)
71647ac2
Do not suppress NIXL shutdown errors
38ffb4e0
Harden NIXL host staging initialization
8c8857fe
Revert "Harden NIXL host staging initialization"
21c6d728
Trim NIXL host staging test scaffolding
20ab4075
review comments
fd2f10cd
Preserve staged transfer failure lifecycle
dfc3f675
Reviewers
Assignees
No one assigned
Labels
documentation
ready
ci/build
deepseek
cpu
kv-connector
nvidia
mrv2
scheduler
kv-cache-manager
minimax
Milestone
No milestone
Login to write a write a comment.
Login via GitHub