vllm
[Bugfix] Fix stale SSM state for new Mamba requests scheduled as decode
#32118
Merged

[Bugfix] Fix stale SSM state for new Mamba requests scheduled as decode #32118

Josephasafg
Josephasafg Changed reorder to prefill and decode logic
e46c1dda
Josephasafg Josephasafg requested a review from LucasWilkinson LucasWilkinson 119 days ago
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2026-01-11
Josephasafg
heheda12345
Josephasafg Added two new test cases to test_batch_reordering
56bcd6d0
Josephasafg
heheda12345
heheda12345 approved these changes on 2026-01-12
heheda12345 heheda12345 enabled auto-merge (squash) 118 days ago
github-actions github-actions added ready
Josephasafg Merge branch 'main' into fix_ssm_stale_states
9955fa23
heheda12345 heheda12345 merged 8fb2c135 into main 118 days ago
pisceskkk
Josephasafg
pisceskkk
Josephasafg

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone