vllm
[Bugfix][Async] Fix async spec decoding with hybrid models
#38556
Merged
Overview
Commits
11
Changes
View On GitHub

[Bugfix][Async] Fix async spec decoding with hybrid models #38556

MatthewBonanni merged 11 commits into vllm-project:main from MatthewBonanni:fix_async_mamba
MatthewBonanni
SandishKumarHN [Spec Decode] Fix backup token off-by-one in async spec decode (prepa…
8bbf3543
SandishKumarHN Address review: rename test_buggy_vs_fixed_diverge_only_with_inflation
7acb546f
SandishKumarHN Simplify comments and rewrite test file for clarity
055ccf27
MatthewBonanni MatthewBonanni requested a review from njhill njhill 192 days ago
MatthewBonanni MatthewBonanni requested a review from benchislett benchislett 192 days ago
MatthewBonanni MatthewBonanni requested a review from luccafong luccafong 192 days ago
claude
claude commented on 2026-03-30
mergify mergify added speculative-decoding
mergify mergify added v1
mergify mergify added bug
gemini-code-assist
gemini-code-assist commented on 2026-03-30
MatthewBonanni MatthewBonanni changed the title [Bugfix] Fix async mamba [WIP][Bugfix] Fix async mamba 192 days ago
MatthewBonanni Fix
ac9338ce
MatthewBonanni Vectorize
68c082d0
MatthewBonanni Clean up seq_lens
987155dd
MatthewBonanni Rename
5fae1b41
MatthewBonanni Clean up
b54dff81
MatthewBonanni Fix bad merge
46fa724d
MatthewBonanni MatthewBonanni force pushed to 46fa724d 192 days ago
MatthewBonanni MatthewBonanni added ready
MatthewBonanni MatthewBonanni changed the title [WIP][Bugfix] Fix async mamba [Bugfix] Fix async mamba 192 days ago
MatthewBonanni MatthewBonanni changed the title [Bugfix] Fix async mamba [Bugfix] Fix async spec decoding with hybrid models 192 days ago
MatthewBonanni MatthewBonanni changed the title [Bugfix] Fix async spec decoding with hybrid models [Bugfix][Async] Fix async spec decoding with hybrid models 192 days ago
MatthewBonanni Fix tests
518fac29
MatthewBonanni Merge branch 'main' into fix_async_mamba
f0dafde7
NickLucche
NickLucche commented on 2026-03-31
benchislett
benchislett approved these changes on 2026-03-31
MatthewBonanni MatthewBonanni merged 757068dc into main 191 days ago
MatthewBonanni MatthewBonanni deleted the fix_async_mamba branch 191 days ago
LucasWilkinson LucasWilkinson added this to the v0.19.0 cherry picks milestone 191 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
bug speculative-decoding ready v1
Milestone
v0.19.0 cherry picks
Terms Of Use Privacy Policy Refund Policy Impressum