vllm
[Core] Use key-only cache for `BaseMultiModalProcessor`
#23018
Merged
Overview
Commits
86
Changes
View On GitHub

[Core] Use key-only cache for `BaseMultiModalProcessor` #23018

DarkLight1337 merged 86 commits into vllm-project:main from DarkLight1337:mm-cache-interface
DarkLight1337
DarkLight1337 [Core] Use key-only cache in P0
d29f791b
DarkLight1337 DarkLight1337 added multi-modality
mergify mergify added llama
mergify mergify added v1
mergify mergify added tpu
github-actions
gemini-code-assist
gemini-code-assist commented on 2025-08-16
DarkLight1337 Fix
e996375b
DarkLight1337 Rename
6b5fa6f8
DarkLight1337 Simplify
ca8fbe12
DarkLight1337 Fix mypy
67e7f8e9
DarkLight1337 Clean
c75474a5
DarkLight1337 Handle DP inside factory
68c01048
DarkLight1337 Doc
15beccd5
DarkLight1337 DarkLight1337 changed the title [Core] Use key-only cache in P0 [Core] Use key-only cache for BaseMultiModalProcessor in P0 120 days ago
DarkLight1337 DarkLight1337 changed the title [Core] Use key-only cache for BaseMultiModalProcessor in P0 [Core] Use key-only cache for `BaseMultiModalProcessor` 120 days ago
mergify mergify added documentation
DarkLight1337 Reorder to fit docs
79aefee5
DarkLight1337 [Refactor] Allow optional MultiModalKwargsItem
353730a8
DarkLight1337 Fix
3b6dc788
DarkLight1337 Merge branch 'optional-mm-item' into mm-cache-interface
c78f259d
DarkLight1337 Message
00a4e73f
DarkLight1337 Fix type annotation
a05829b2
DarkLight1337 Update
6881cf3c
DarkLight1337 Update
219381e5
DarkLight1337 More WIP
b7d1b17d
mergify mergify added qwen
mergify
mergify mergify added needs-rebase
DarkLight1337
DarkLight1337 commented on 2025-08-17
DarkLight1337 [Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs
5147bb1c
DarkLight1337 Update docs
28cc31d9
DarkLight1337 Fixes
a032c234
DarkLight1337 Fix test
01c9a24e
DarkLight1337 Fix cache
3055f821
DarkLight1337 Fix cache
af3fb3da
DarkLight1337 Rename
220bdfc1
DarkLight1337 Fix common processor test
9fa89a17
DarkLight1337 Fix equality check
ed614e16
DarkLight1337 Fix mypy
4df611aa
DarkLight1337 Fixes
b6b0ff83
DarkLight1337 Fix serialization
09acec29
DarkLight1337 Fix caching
95ed7ecf
DarkLight1337 Fix test
3b0096f1
DarkLight1337 Merge branch 'main' into separate-mm-kwargs
5fbd8247
DarkLight1337 Add deprecation
946958ac
DarkLight1337 Update types
ef8e93b1
DarkLight1337 Merge branch 'separate-mm-kwargs' into mm-cache-interface
dc5ee9b2
mergify mergify added deepseek
mergify mergify removed needs-rebase
DarkLight1337 [Refactor] Get prompt updates earlier
4844d330
DarkLight1337 Fix
b5cb48d9
DarkLight1337 Merge branch 'prompt-updates' into mm-cache-interface
dbb7ccdf
DarkLight1337 define proxy
c74b4130
DarkLight1337 Update
ac738bbe
DarkLight1337 Remove requires_out_mm
2f58b27b
DarkLight1337 Update
480d5fc7
DarkLight1337 Fixes
05937e2f
DarkLight1337 Fix mypy
5199f411
DarkLight1337 Fix
3cb51ac5
DarkLight1337 Clean up
b7404d69
DarkLight1337 Fix incorrect index
40fcfea2
DarkLight1337
DarkLight1337 commented on 2025-08-19
DarkLight1337 Improve doc
c909f6f7
DarkLight1337 DarkLight1337 added ready
DarkLight1337 DarkLight1337 marked this pull request as ready for review 117 days ago
DarkLight1337 DarkLight1337 requested a review from patrickvonplaten patrickvonplaten 117 days ago
DarkLight1337 DarkLight1337 requested a review from hmellor hmellor 117 days ago
DarkLight1337 DarkLight1337 requested a review from ywang96 ywang96 117 days ago
DarkLight1337 DarkLight1337 requested a review from WoosukKwon WoosukKwon 117 days ago
DarkLight1337 DarkLight1337 requested a review from robertgshaw2-redhat robertgshaw2-redhat 117 days ago
DarkLight1337 DarkLight1337 requested a review from njhill njhill 117 days ago
DarkLight1337 DarkLight1337 requested a review from comaniac comaniac 117 days ago
DarkLight1337 DarkLight1337 requested a review from alexm-redhat alexm-redhat 117 days ago
DarkLight1337 DarkLight1337 requested a review from simon-mo simon-mo 117 days ago
DarkLight1337 DarkLight1337 requested a review from youkaichao youkaichao 117 days ago
DarkLight1337 DarkLight1337 requested a review from mgoin mgoin 117 days ago
DarkLight1337 DarkLight1337 requested a review from tlrmchlsmth tlrmchlsmth 117 days ago
DarkLight1337 DarkLight1337 requested a review from houseroad houseroad 117 days ago
DarkLight1337 DarkLight1337 requested a review from yewentao256 yewentao256 117 days ago
DarkLight1337 DarkLight1337 requested a review from ProExpertProg ProExpertProg 117 days ago
DarkLight1337 DarkLight1337 requested a review from zhuohan123 zhuohan123 117 days ago
DarkLight1337 Improve doc
96341c19
DarkLight1337 DarkLight1337 removed ready
DarkLight1337 Simplify
486f2fcd
DarkLight1337 Typo
fbf8aca1
DarkLight1337 Fix type annotation
cd4be9ae
DarkLight1337 Fix MiniCPMV
a8b4607f
DarkLight1337 Simplify
c3661ba0
DarkLight1337 Fix missing prompt updates
0585a3ed
DarkLight1337 Fix Phi3V and Phi4MM
a6e25168
DarkLight1337 Fix cache checking
03c18b6c
DarkLight1337 DarkLight1337 added ready
DarkLight1337
DarkLight1337 Merge branch 'main' into mm-cache-interface
d837dcce
DarkLight1337 Merge branch 'main' into mm-cache-interface
232b92a8
tanruixiang
tanruixiang commented on 2025-08-20
mergify
mergify mergify added needs-rebase
DarkLight1337 Merge branch 'main' into mm-cache-interface
a27faafa
DarkLight1337 Merge branch 'main' into mm-cache-interface
d96ef41c
mergify mergify removed needs-rebase
DarkLight1337 Remove warning
674109c7
ywang96
ywang96 commented on 2025-08-21
ywang96
ywang96 commented on 2025-08-21
DarkLight1337 Update docstring
589c89a4
DarkLight1337 Initialize cache internally
14e802be
DarkLight1337 Simplify
fa2ae903
DarkLight1337 Update cache factories
c4d59912
DarkLight1337 Remove unused logger
16ec3680
DarkLight1337 Merge branch 'main' into mm-cache-interface
149076d4
DarkLight1337 [Refactor] Enable multiple targets per prompt update definition
985fad4b
DarkLight1337 Wrong format specifier
ba91f95d
DarkLight1337 Comment
afb22c84
DarkLight1337 Merge branch 'one-replacement-per-modality' into mm-cache-interface
42a9788c
DarkLight1337 Update processing
ab0fa80a
DarkLight1337 Clean up
603240d4
DarkLight1337 Comment
b6cabf4c
DarkLight1337 Merge branch 'one-replacement-per-modality' into mm-cache-interface
bd2a3826
DarkLight1337 Update
79704be9
DarkLight1337 DarkLight1337 marked this pull request as draft 112 days ago
DarkLight1337
DarkLight1337 Fix
0aa7a3cb
DarkLight1337 Merge branch 'main' into mm-cache-interface
7e87cfa6
DarkLight1337 DarkLight1337 marked this pull request as ready for review 110 days ago
DarkLight1337
DarkLight1337 Fix cache tests
b31b6193
DarkLight1337 Fix Phi3V
e80c84bb
DarkLight1337 Merge branch 'main' into mm-cache-interface
9818ed2e
Isotr0py
Isotr0py approved these changes on 2025-08-25
DarkLight1337 Merge branch 'main' into mm-cache-interface
d617f251
DarkLight1337 Merge branch 'main' into mm-cache-interface
0704b076
DarkLight1337 Fixes
a88c6069
mergify
mergify mergify added needs-rebase
DarkLight1337 Merge branch 'main' into mm-cache-interface
99049ec1
mergify mergify removed needs-rebase
DarkLight1337 DarkLight1337 merged 69244e67 into main 109 days ago
DarkLight1337 DarkLight1337 deleted the mm-cache-interface branch 109 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
documentation tpu ready v1 multi-modality llama qwen deepseek
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum