PR #18212 [V1] Support cross-layer KV sharing

[V1] Support cross-layer KV sharing #18212

heheda12345 merged 6 commits into vllm-project:main from sarckk:kv-sharing

mergify added v1

mergify added tpu

sarckk force pushed 211 days ago

sarckk marked this pull request as ready for review 211 days ago

sarckk requested a review from

WoosukKwon 211 days ago

sarckk requested a review from

robertgshaw2-redhat 211 days ago

sarckk requested a review from

njhill 211 days ago

sarckk requested a review from

ywang96 211 days ago

sarckk requested a review from

comaniac 211 days ago

sarckk requested a review from

alexm-redhat 211 days ago

luccafong commented on 2025-05-15

heheda12345 requested a review from

heheda12345 211 days ago

mergify added needs-rebase

sarckk force pushed 206 days ago

mergify removed needs-rebase

heheda12345 commented on 2025-05-19

mergify added needs-rebase

heheda12345 commented on 2025-05-23

sarckk force pushed 199 days ago

sarckk requested a review from

zhuohan123 199 days ago

sarckk requested a review from

youkaichao 199 days ago

mergify removed needs-rebase

sarckk force pushed 199 days ago

heheda12345 commented on 2025-05-28

mergify added needs-rebase

sarckk force pushed 197 days ago

mergify removed needs-rebase

heheda12345 commented on 2025-05-30

mergify added needs-rebase

sarckk force pushed 193 days ago

mergify removed needs-rebase

heheda12345 commented on 2025-06-03

heheda12345 approved these changes on 2025-06-03

heheda12345 enabled auto-merge (squash) 193 days ago

github-actions added ready

[V1] Support cross-layer KV sharing

27acd512

small reorder for v1 check

0eac3fb6

refactor

61d6ac44

address comments

b3ee6cf2

Improve comments

1ad1052c

Fix triton backend and update comments

97dd1253

disabled auto-merge 192 days ago
Head branch was pushed to by a user without write access

sarckk force pushed to 97dd1253 192 days ago

heheda12345 enabled auto-merge (squash) 192 days ago

heheda12345 merged bdf13965 into main 192 days ago

sarckk deleted the kv-sharing branch 183 days ago

Reviewers

heheda12345

luccafong

WoosukKwon

robertgshaw2-redhat

njhill

ywang96

comaniac

alexm-redhat

zhuohan123

youkaichao

Assignees

No one assigned

Labels

tpu ready v1

Milestone

No milestone

vllm [V1] Support cross-layer KV sharing #18212 Merged

[V1] Support cross-layer KV sharing #18212

vllm
[V1] Support cross-layer KV sharing
#18212

Merged