vllm
[Core] Support `min_tokens` with speculative decoding
#32642

Merged

[Core] Support `min_tokens` with speculative decoding #32642

benchislett merged 4 commits into vllm-project:main from qianlihuang:feature/spec-dec-min-tokens

mergify added v1

gemini-code-assist commented on 2026-01-20

qianlihuang changed the title ~~Feat: add sampling (min_tokens,...) support for speculative decoding~~ [Core] Support `min_tokens` with speculative decoding 109 days ago

qianlihuang marked this pull request as ready for review 109 days ago

qianlihuang requested a review from

22quinn 109 days ago

qianlihuang requested a review from

houseroad 109 days ago

qianlihuang requested a review from

njhill 109 days ago

qianlihuang requested a review from

copilot-pull-request-reviewer 109 days ago

copilot-pull-request-reviewer commented on 2026-01-21

qianlihuang force pushed 109 days ago

qianlihuang force pushed 107 days ago

benchislett commented on 2026-02-01

qianlihuang marked this pull request as draft 97 days ago

qianlihuang force pushed 96 days ago

mergify added documentation

mergify added ci/build

mergify added deepseek

mergify added frontend

mergify added llama

mergify added multi-modality

mergify added new-model

mergify added performance

mergify added qwen

mergify added gpt-oss

mergify added nvidia

mergify added rocm

mergify added cpu

mergify added structured-output

mergify added speculative-decoding

mergify added tpu

mergify added tool-calling

mergify added kv-connector

mergify added needs-rebase

qianlihuang closed this 96 days ago

qianlihuang force pushed to 808dd87b 96 days ago

mergify removed tpu

qianlihuang reopened this 96 days ago

mergify removed needs-rebase

qianlihuang force pushed 96 days ago

qianlihuang marked this pull request as ready for review 96 days ago

qianlihuang marked this pull request as draft 96 days ago

qianlihuang marked this pull request as ready for review 96 days ago

benchislett commented on 2026-02-04

qianlihuang marked this pull request as draft 94 days ago

qianlihuang force pushed 94 days ago

qianlihuang marked this pull request as ready for review 94 days ago

benchislett commented on 2026-02-17

mergify added needs-rebase

mergify removed needs-rebase

qianlihuang requested a review from

NickLucche 75 days ago

[Core] Support min_tokens with speculative decoding

f69f5526

qianlihuang force pushed to f69f5526 75 days ago

benchislett commented on 2026-02-25

add comment

c325db58

benchislett approved these changes on 2026-02-25

benchislett added ready

benchislett enabled auto-merge (squash) 74 days ago

Update custom logitsproc spec-dec test expectation

1abd6dd8

disabled auto-merge 73 days ago
Head branch was pushed to by a user without write access

Merge branch 'main' into feature/spec-dec-min-tokens

6e4252c4

benchislett merged d9406076 into main 73 days ago

Reviewers

benchislett

copilot-pull-request-reviewer

gemini-code-assist

22quinn

houseroad

njhill

NickLucche

Assignees

No one assigned

Labels

documentation performance new-model rocm structured-output frontend speculative-decoding ready ci/build v1 multi-modality tool-calling llama qwen deepseek cpu gpt-oss kv-connector nvidia

Milestone

No milestone

vllm [Core] Support `min_tokens` with speculative decoding #32642 Merged

[Core] Support `min_tokens` with speculative decoding #32642

vllm
[Core] Support `min_tokens` with speculative decoding
#32642

Merged