vllm
[V1] [Hybrid] Some additional clean-up in Mamba2 prefix caching
#26222
Merged
Overview
Commits
19
Changes
View On GitHub

[V1] [Hybrid] Some additional clean-up in Mamba2 prefix caching #26222

heheda12345 merged 19 commits into main from mamba-prefix-cache-postmerge
tdoublep
tdoublep seq_lens_pending -> query_lens
7579fdd1
tdoublep Simplification
1548bf76
tdoublep Remove line break
141258a0
tdoublep Remove line break
a517536c
tdoublep Remove redundant branch
4a4ae236
tdoublep Cleanup code for writing mamba states
561b5f78
tdoublep Remove last_computed_offset
f8857640
tdoublep context_lens -> num_computed_tokens
e3699c90
tdoublep Fix indexing bug
bddbedaf
tdoublep Fix issue for eager mode
b16a7883
tdoublep Rename tensors
f671288d
tdoublep Fix small bug
9a37a6a4
tdoublep add shapes
1d20e4e8
tdoublep tdoublep requested a review from WoosukKwon WoosukKwon 132 days ago
tdoublep tdoublep requested a review from robertgshaw2-redhat robertgshaw2-redhat 132 days ago
tdoublep tdoublep requested a review from njhill njhill 132 days ago
tdoublep tdoublep requested a review from ywang96 ywang96 132 days ago
tdoublep tdoublep requested a review from comaniac comaniac 132 days ago
tdoublep tdoublep requested a review from alexm-redhat alexm-redhat 132 days ago
tdoublep tdoublep requested a review from heheda12345 heheda12345 132 days ago
tdoublep tdoublep requested a review from ApostaC ApostaC 132 days ago
tdoublep tdoublep requested a review from LucasWilkinson LucasWilkinson 132 days ago
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2025-10-04
chatgpt-codex-connector
chatgpt-codex-connector commented on 2025-10-04
tdoublep Review comments
9bdd0c89
tdoublep Simplify logic a bit
9f2e99c3
tdoublep tdoublep added ready
tdoublep Merge branch 'main' into mamba-prefix-cache-postmerge
d0f23588
tdoublep Merge branch 'main' into mamba-prefix-cache-postmerge
752b58a4
tdoublep format my files
b5df5fbf
tdoublep merge main
64024373
heheda12345
heheda12345 approved these changes on 2025-10-06
heheda12345 heheda12345 merged 778f5541 into main 130 days ago
heheda12345 heheda12345 deleted the mamba-prefix-cache-postmerge branch 130 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready v1
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum