vllm
[Model Runner V2][Spec Decode] Fix draft logits cache column stride in gumbel_sample
#53017

Merged

[Model Runner V2][Spec Decode] Fix draft logits cache column stride in gumbel_sample #53017

WoosukKwon merged 1 commit into vllm-project:main from TheEpicDolphin:mrv2-fix-draft-logits-cache-stride

[Model Runner V2][Spec Decode] Fix draft logits cache column stride i…

7498b426

mergify added speculative-decoding

mergify added mrv2

TheEpicDolphin marked this pull request as ready for review 25 days ago

TheEpicDolphin requested a review from

WoosukKwon 25 days ago

TheEpicDolphin requested a review from

njhill 25 days ago

TheEpicDolphin requested a review from

yewentao256 25 days ago

claude commented on 2026-08-19

TheEpicDolphin added ready

WoosukKwon approved these changes on 2026-08-20

WoosukKwon merged d4f4d3f4 into main 25 days ago

TheEpicDolphin deleted the mrv2-fix-draft-logits-cache-stride branch 25 days ago

Reviewers

WoosukKwon

claude

njhill

yewentao256

Assignees

No one assigned

Labels

speculative-decoding ready mrv2

Milestone

No milestone