vllm
[V1] Move KV block hashes from Request to KVCacheManager
#12922

Merged

[V1] Move KV block hashes from Request to KVCacheManager #12922

WoosukKwon merged 6 commits into main from v1-mv-block-hashes

[V1] Move block hashes to KV cache manager

3c405d94

free

b01caa19

WoosukKwon requested a review from

robertgshaw2-redhat 313 days ago

WoosukKwon requested a review from

njhill 313 days ago

WoosukKwon requested a review from

ywang96 313 days ago

WoosukKwon requested a review from

comaniac 313 days ago

WoosukKwon requested a review from

alexm-redhat 313 days ago

mergify added v1

add note

07e7c8f9

minor

eabab9ee

comaniac approved these changes on 2025-02-07

Fix comments

55ffb698

WoosukKwon added ready

comaniac enabled auto-merge (squash) 313 days ago

del -> pop

5278ed01

disabled auto-merge 313 days ago
Manually disabled by user

WoosukKwon merged 32431583 into main 313 days ago

WoosukKwon deleted the v1-mv-block-hashes branch 313 days ago

Reviewers

comaniac

robertgshaw2-redhat

njhill

ywang96

alexm-redhat

Assignees

No one assigned

Labels

ready v1

Milestone

No milestone