vllm
[Bugfix] Fix block_size for hybrid model MTP
#36036

Merged

[Bugfix] Fix block_size for hybrid model MTP #36036

benchislett merged 3 commits into vllm-project:main from CentML:eagle-fix-block-size

Use the proper block size for drafting

23041c4a

benchislett requested a review from

LucasWilkinson 71 days ago

benchislett requested a review from

luccafong 71 days ago

benchislett requested a review from

MatthewBonanni 71 days ago

mergify added speculative-decoding

mergify added v1

mergify added bug

gemini-code-assist commented on 2026-03-04

LucasWilkinson approved these changes on 2026-03-04

benchislett added ready

benchislett enabled auto-merge (squash) 70 days ago

set block size in test

24c3aa28

Merge branch 'main' into eagle-fix-block-size

92d123ff

benchislett merged 57c629e9 into main 70 days ago

Reviewers

LucasWilkinson

gemini-code-assist

luccafong

MatthewBonanni

Assignees

No one assigned

Labels

bug speculative-decoding ready v1

Milestone

No milestone