PR #35678 [Not review]Xiong/block kv integration

[Not review]Xiong/block kv integration #35678

intelgaoxiong wants to merge 4 commits into openvinotoolkit:master from intelgaoxiong:xiong/block_kv_integration

github-actions added category: build

github-actions added category: NPU

github-actions added category: NPUW

rkazants requested a review from

rkazants 90 days ago

intelgaoxiong marked this pull request as ready for review 89 days ago

intelgaoxiong requested a review 89 days ago

intelgaoxiong force pushed from 5d2abf25 to b27db417 89 days ago

intelgaoxiong force pushed from b27db417 to ef39d2ac 89 days ago

intelgaoxiong force pushed from ef39d2ac to e969af55 89 days ago

intelgaoxiong force pushed from e969af55 to fe695640 89 days ago

intelgaoxiong force pushed from fe695640 to b0b1a201 89 days ago

intelgaoxiong force pushed from b0b1a201 to 520e580c 89 days ago

intelgaoxiong force pushed from 520e580c to 60d45a92 89 days ago

intelgaoxiong force pushed from 60d45a92 to 54103e84 88 days ago

intelgaoxiong force pushed from 54103e84 to 3f86824b 88 days ago

intelgaoxiong force pushed from 3f86824b to 8e8885e0 88 days ago

[NPUW] Introduce SplitKVCacheIntoBlocks model transformation.

5d5b0e2c

[NPUW] Introduce KVCacheBlockManager for block-based KV cache memory …

ae8c7b7a

[NPUW] Add block-based KV cache support for HFA and Pyramid attention

7d8ef603

[NPUW] Block-based KV cache runtime integration

0bb0f8de

intelgaoxiong force pushed from 8e8885e0 to 0bb0f8de 88 days ago

intelgaoxiong closed this 60 days ago

Reviewers

rkazants

Assignees

No one assigned

Labels

category: build category: NPU category: NPUW

Milestone

No milestone