vllm
[KVConnector][Core] Support cross-layer KV blocks
#27743

Merged

[KVConnector][Core] Support cross-layer KV blocks #27743

NickLucche merged 1 commit into vllm-project:main from orozery:contiguous-kv-layers

orozery requested a review from

mgoin 277 days ago

orozery requested a review from

pavanimajety 277 days ago

orozery requested a review from

LucasWilkinson 277 days ago

orozery requested a review from

NickLucche 277 days ago

orozery requested a review from

ApostaC 277 days ago

orozery requested a review from

WoosukKwon 277 days ago

orozery requested a review from

zhuohan123 277 days ago

orozery requested a review from

youkaichao 277 days ago

orozery requested a review from

alexm-redhat 277 days ago

orozery requested a review from

comaniac 277 days ago

orozery requested a review from

njhill 277 days ago

mergify added v1

mergify added needs-rebase

mergify added kv-connector

gemini-code-assist commented on 2025-10-29

orozery force pushed 277 days ago

mergify removed needs-rebase

orozery force pushed 277 days ago

njhill commented on 2025-10-29

orozery force pushed 277 days ago

orozery changed the title ~~GPUModelRunner: Support contiguous KV data across layers~~ GPUModelRunner: Support cross-layer KV blocks 277 days ago

ApostaC requested changes on 2025-10-29

orozery force pushed 273 days ago

mergify removed needs-rebase

orozery force pushed 273 days ago

mergify added needs-rebase

heheda12345 commented on 2025-11-02

NickLucche commented on 2025-11-03

NickLucche changed the title ~~GPUModelRunner: Support cross-layer KV blocks~~ [KVConnector] Support cross-layer KV blocks 272 days ago

NickLucche changed the title ~~[KVConnector] Support cross-layer KV blocks~~ [KVConnector][Core] Support cross-layer KV blocks 272 days ago

orozery force pushed 269 days ago

heheda12345 commented on 2025-11-06

orozery force pushed 266 days ago

mergify added nvidia

orozery force pushed 257 days ago

orozery force pushed to c177cea1 257 days ago

NickLucche commented on 2025-11-19

orozery force pushed from c177cea1 256 days ago

mergify added needs-rebase

orozery force pushed 256 days ago

mergify removed needs-rebase

NickLucche approved these changes on 2025-11-19

NickLucche added ready

ApostaC commented on 2025-11-19

orozery force pushed 255 days ago

heheda12345 commented on 2025-11-19

heheda12345 approved these changes on 2025-11-20

[KVConnector][Core] Support cross-layer KV blocks

a58c3760

orozery force pushed to a58c3760 255 days ago

ApostaC approved these changes on 2025-11-20

NickLucche merged 64746471 into main 254 days ago

Reviewers

ApostaC

heheda12345

NickLucche

njhill

gemini-code-assist

mgoin

pavanimajety

LucasWilkinson

WoosukKwon

zhuohan123

youkaichao

alexm-redhat

comaniac

Assignees

No one assigned

Labels

ready v1 kv-connector nvidia

Milestone

No milestone

vllm [KVConnector][Core] Support cross-layer KV blocks #27743 Merged

[KVConnector][Core] Support cross-layer KV blocks #27743

vllm
[KVConnector][Core] Support cross-layer KV blocks
#27743

Merged