vllm
fix(spec_decode): ensure draft model uses correct parallel/model config in all proposers
#44086

Open

fix(spec_decode): ensure draft model uses correct parallel/model config in all proposers #44086

anmolxlight wants to merge 1 commit into vllm-project:main from anmolxlight:fix-44063-eagle3-tp-nccl

fix(spec_decode): ensure draft model uses correct parallel/model conf…

84e58536

anmolxlight requested a review from

benchislett 4 days ago

anmolxlight requested a review from

luccafong 4 days ago

anmolxlight requested a review from

MatthewBonanni 4 days ago

mergify added speculative-decoding

mergify added v1

Reviewers

benchislett

luccafong

MatthewBonanni

Assignees

No one assigned

Labels

speculative-decoding v1

Milestone

No milestone