vllm
[Mamba1] - Kernel Level Chunk Alignment for Prefix Caching
#34798
Merged

[Mamba1] - Kernel Level Chunk Alignment for Prefix Caching #34798

Josephasafg
Josephasafg Added chunk alignment to selective scan
b2c42e48
Josephasafg Josephasafg requested a review from LucasWilkinson LucasWilkinson 81 days ago
Josephasafg Josephasafg requested a review from tdoublep tdoublep 81 days ago
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2026-02-18
divakar-amd
divakar-amd requested changes on 2026-02-19
Josephasafg Merge branch 'main' of https://github.com/vllm-project/vllm into mamb…
a7584490
Josephasafg Removed unused kchunksize
0cf2b77f
Josephasafg Removed kNThreads
52db1e52
Josephasafg Merge branch 'main' into mamba1-chunk-alignment-upstream
063fe4db
divakar-amd
Josephasafg Merge branch 'main' into mamba1-chunk-alignment-upstream
d055445d
Josephasafg
tdoublep
tdoublep commented on 2026-02-22
Josephasafg Removed logic from mamba1 attn and used in the mixer
8a2e34a6
Josephasafg Used existing computing logic both both mamba types when aligning chunks
732167b5
mergify
Josephasafg mypy fix
0dce84ad
Josephasafg
Josephasafg Josephasafg requested a review from tdoublep tdoublep 76 days ago
mergify
mergify mergify added needs-rebase
Josephasafg Merge branch 'main' of https://github.com/vllm-project/vllm into mamb…
39390104
Josephasafg Josephasafg force pushed to 39390104 75 days ago
mergify mergify removed needs-rebase
Josephasafg Merge branch 'main' into mamba1-chunk-alignment-upstream
d407054a
Josephasafg Josephasafg requested a review from MatthewBonanni MatthewBonanni 74 days ago
mergify
Josephasafg Added missing func arg
0ba69307
Josephasafg Chaned func signature to kwargs
790405ec
Josephasafg Moved block_idx_completed
225c0aa2
tdoublep
tdoublep approved these changes on 2026-02-27
tdoublep tdoublep added ready
Josephasafg Fixed params for mamba ssm test
f718db0f
Josephasafg Josephasafg force pushed to f718db0f 72 days ago
Josephasafg Josephasafg requested a review from mgoin mgoin 72 days ago
Josephasafg Josephasafg requested a review from tlrmchlsmth tlrmchlsmth 72 days ago
Josephasafg Josephasafg requested a review from WoosukKwon WoosukKwon 72 days ago
Josephasafg Josephasafg requested a review from yewentao256 yewentao256 72 days ago
Josephasafg Merge branch 'main' into mamba1-chunk-alignment-upstream
8b8d28bd
DarkLight1337 DarkLight1337 merged bbf81f9a into main 70 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone