vllm
[Perf][KV Offload] Avoid quadratic ARC batch eviction
#50992
Open

[Perf][KV Offload] Avoid quadratic ARC batch eviction #50992

mindungil
mindungil [KV Offload] Make ARC batch eviction linear
6b637782
mindungil [KV Offload] Strengthen ARC batch eviction tests
6bdb52cd
mindungil mindungil force pushed from 7e3c0a13 to 6bdb52cd 17 hours ago
mergify mergify added bug
mindungil mindungil marked this pull request as ready for review 16 hours ago
mindungil mindungil requested a review from ApostaC ApostaC 16 hours ago
mindungil mindungil requested a review from orozery orozery 16 hours ago
claude
claude commented on 2026-08-04
orozery orozery changed the title [Bugfix][KV Offload] Avoid quadratic ARC batch eviction [Perf][KV Offload] Avoid quadratic ARC batch eviction 15 hours ago
orozery
orozery commented on 2026-08-04
mindungil [KV Offload] Cover exhausted ARC T1 fallback
5cd9fb5f
mindungil
orozery orozery added ready
mindungil Merge branch 'main' into agent/linearize-arc-eviction
2e426b77

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone