vllm
[Spec Decode] Don't fall back to V0 when spec decoding is enabled
#18265

Merged

[Spec Decode] Don't fall back to V0 when spec decoding is enabled #18265

WoosukKwon merged 1 commit into main from enable-spec

[Spec Decode] Don't fall back to V0 when spec decoding is enabled

83b088a2

markmc approved these changes on 2025-05-16

markmc added speculative-decoding

markmc added v1

WoosukKwon added ready

WoosukKwon merged fabe89bb into main 260 days ago

WoosukKwon deleted the enable-spec branch 260 days ago

Reviewers

markmc

Assignees

No one assigned

Labels

speculative-decoding ready v1

Milestone

No milestone