vllm
[Core] Use individual MM items in P0/P1 cache and model runner
#22570
Merged
Overview
Commits
16
Changes
View On GitHub

[Core] Use individual MM items in P0/P1 cache and model runner #22570

vllm-bot merged 16 commits into vllm-project:main from DarkLight1337:mm-cache-item
DarkLight1337
DarkLight1337 [Core] Use individual MM items in P0/P1 cache and model runner
ec347bfc
DarkLight1337 DarkLight1337 requested a review from Isotr0py Isotr0py 357 days ago
DarkLight1337 DarkLight1337 requested a review from ywang96 ywang96 357 days ago
DarkLight1337 DarkLight1337 requested a review from WoosukKwon WoosukKwon 357 days ago
DarkLight1337 DarkLight1337 requested a review from robertgshaw2-redhat robertgshaw2-redhat 357 days ago
DarkLight1337 DarkLight1337 requested a review from njhill njhill 357 days ago
DarkLight1337 DarkLight1337 requested a review from comaniac comaniac 357 days ago
DarkLight1337 DarkLight1337 requested a review from alexm-redhat alexm-redhat 357 days ago
github-actions
mergify mergify added multi-modality
mergify mergify added v1
mergify mergify added tpu
gemini-code-assist
gemini-code-assist commented on 2025-08-09
DarkLight1337 Address comment
c4da5dc4
DarkLight1337 Address comment
3a36adb9
DarkLight1337
DarkLight1337 commented on 2025-08-09
DarkLight1337
DarkLight1337 commented on 2025-08-09
DarkLight1337 Assertion
d5b74ad0
DarkLight1337 Merge branch 'main' into mm-cache-item
bd05abb2
Isotr0py
Isotr0py approved these changes on 2025-08-10
DarkLight1337 DarkLight1337 added ready
DarkLight1337 Address comment; add back-compat
426061de
DarkLight1337
huachenheli
huachenheli commented on 2025-08-11
huachenheli
huachenheli commented on 2025-08-11
DarkLight1337
DarkLight1337 Merge branch 'main' into mm-cache-item
9c4406c5
DarkLight1337 Update type annotations and message
193f9e80
DarkLight1337 Fix wrong `is_empty`
e691d973
DarkLight1337 Rename
e3c85e4f
DarkLight1337 Reduce diff
735708af
DarkLight1337 Merge branch 'main' into mm-cache-item
938c9d06
DarkLight1337 Fix
ca9b1c19
DarkLight1337 Fix wrong types
9ce07f9f
DarkLight1337 Avoid in-place updates
8e32d7ec
mergify
mergify mergify added needs-rebase
DarkLight1337 Merge branch 'main' into mm-cache-item
42fbdf83
mergify mergify removed needs-rebase
vllm-bot vllm-bot merged 19b927e5 into main 353 days ago
DarkLight1337 DarkLight1337 deleted the mm-cache-item branch 353 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
tpu ready v1 multi-modality
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum