vllm
[Misc][Spec Decode] support different load config for draft model
#34022
Merged
Overview
Commits
3
Changes
View On GitHub

[Misc][Spec Decode] support different load config for draft model #34022

luccafong merged 3 commits into vllm-project:main from ZhengkaiZ:eagle3
ZhengkaiZ
ZhengkaiZ ZhengkaiZ requested a review from benchislett benchislett 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from luccafong luccafong 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from WoosukKwon WoosukKwon 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from youkaichao youkaichao 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from robertgshaw2-redhat robertgshaw2-redhat 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from mgoin mgoin 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from tlrmchlsmth tlrmchlsmth 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from houseroad houseroad 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from hmellor hmellor 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from yewentao256 yewentao256 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from ProExpertProg ProExpertProg 100 days ago
ZhengkaiZ ZhengkaiZ requested a review from 22quinn 22quinn 100 days ago
mergify mergify added speculative-decoding
mergify mergify added v1
ZhengkaiZ ZhengkaiZ marked this pull request as draft 100 days ago
gemini-code-assist
gemini-code-assist commented on 2026-02-06
ZhengkaiZ ZhengkaiZ closed this 100 days ago
ZhengkaiZ ZhengkaiZ changed the title Eagle3 [Misc][Spec Decode] support different load config for draft model 100 days ago
ZhengkaiZ ZhengkaiZ reopened this 100 days ago
ZhengkaiZ ZhengkaiZ marked this pull request as ready for review 100 days ago
ZhengkaiZ ZhengkaiZ marked this pull request as draft 100 days ago
ZhengkaiZ ZhengkaiZ force pushed 100 days ago
ZhengkaiZ ZhengkaiZ marked this pull request as ready for review 99 days ago
houseroad
houseroad approved these changes on 2026-02-10
houseroad houseroad added ready
ZhengkaiZ
[Misc][Spec Decode] Support different model load config for draft model
aebfc0ef
formatting
9787c9a6
directly using speculative config to access load config
e6c24579
mergify
ZhengkaiZ ZhengkaiZ force pushed to e6c24579 96 days ago
luccafong luccafong merged 6f2f59f2 into main 96 days ago
ZhengkaiZ ZhengkaiZ deleted the eagle3 branch 95 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
speculative-decoding ready v1
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum