vllm
[Dynamic Spec Decoding] Minor fix for disabling speculative decoding
#5000

Merged

[Dynamic Spec Decoding] Minor fix for disabling speculative decoding #5000

simon-mo merged 3 commits into main from disable-queue-size

test and fix

adaccf8e

LiuXiaoxuanPKU requested a review from

cadedaniel 1 year ago

LiuXiaoxuanPKU requested a review from

comaniac 1 year ago

comaniac approved these changes on 2024-05-23

cadedaniel approved these changes on 2024-05-23

fix comments

e027eb67

fix tests

b83f540a

simon-mo merged d5a16977 into main 1 year ago

simon-mo deleted the disable-queue-size branch 1 year ago

Reviewers

cadedaniel

comaniac

Assignees

No one assigned

Labels

None yet

Milestone

No milestone