vllm
[Perf][HiSparse] Avoid repeated prefix scans and residency updates
#57930
Merged
Overview
Commits
6
Changes
View On GitHub

[Perf][HiSparse] Avoid repeated prefix scans and residency updates #57930

MatthewBonanni merged 6 commits into vllm-project:main from S1ro1:fix/hisparse-scheduler-overhead
S1ro1
mergify mergify added kv-cache-manager
S1ro1 S1ro1 marked this pull request as ready for review 32 days ago
S1ro1 S1ro1 requested a review from WoosukKwon WoosukKwon 32 days ago
S1ro1 S1ro1 requested a review from robertgshaw2-redhat robertgshaw2-redhat 32 days ago
S1ro1 S1ro1 requested a review from njhill njhill 32 days ago
S1ro1 S1ro1 requested a review from ywang96 ywang96 32 days ago
S1ro1 S1ro1 requested a review from alexm-redhat alexm-redhat 32 days ago
S1ro1 S1ro1 requested a review from heheda12345 heheda12345 32 days ago
S1ro1 S1ro1 requested a review from ApostaC ApostaC 32 days ago
S1ro1 S1ro1 requested a review from orozery orozery 32 days ago
S1ro1 S1ro1 requested a review from ivanium ivanium 32 days ago
claude
claude commented on 2026-09-21
NickLucche
NickLucche commented on 2026-09-21
LucasWilkinson
LucasWilkinson LucasWilkinson requested a review from xuechendi xuechendi 25 days ago
mergify mergify added kv-connector
mergify
mergify mergify added needs-rebase
S1ro1 [Perf][HiSparse] Avoid repeated prefix scans and residency updates
b2f33658
LucasWilkinson [HiSparse] Run per-step residency work from the connector
219fb070
MatthewBonanni [HiSparse] Publish adopted GPU copies from the per-step residency pass
b6de3c8a
MatthewBonanni MatthewBonanni force pushed from 4026f8a1 to b6de3c8a 22 days ago
MatthewBonanni MatthewBonanni requested a review from wzhao18 wzhao18 22 days ago
mergify mergify removed needs-rebase
MatthewBonanni [HiSparse] Keep reprefillable tokens out of per-step write-backs
cd13576b
MatthewBonanni [HiSparse] Simplify per-step residency test helper
22e3bc84
MatthewBonanni Merge remote-tracking branch 'upstream/main' into fix/hisparse-schedu…
c88131e4
MatthewBonanni
github-actions
MatthewBonanni
MatthewBonanni approved these changes on 2026-10-01
MatthewBonanni MatthewBonanni enabled auto-merge (squash) 22 days ago
github-actions github-actions added ready
MatthewBonanni MatthewBonanni merged ca65eb67 into main 22 days ago
MatthewBonanni MatthewBonanni added hisparse

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready kv-connector kv-cache-manager hisparse
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum