vllm
[Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding
#35158
Merged
Overview
Commits
10
Changes
View On GitHub

[Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding #35158

NickLucche merged 10 commits into vllm-project:main from ZhanqiuHu:pd-sd-wait-for-save
ZhanqiuHu
ZhanqiuHu ZhanqiuHu requested a review from ApostaC ApostaC 75 days ago
ZhanqiuHu ZhanqiuHu requested a review from orozery orozery 75 days ago
ZhanqiuHu ZhanqiuHu requested a review from NickLucche NickLucche 75 days ago
mergify mergify added ci/build
mergify mergify added v1
mergify mergify added kv-connector
gemini-code-assist
gemini-code-assist commented on 2026-02-24
ZhanqiuHu ZhanqiuHu force pushed 75 days ago
NickLucche
NickLucche commented on 2026-02-24
NickLucche NickLucche added ready
ZhanqiuHu ZhanqiuHu force pushed 75 days ago
ZhanqiuHu [kv-connector] Defer wait_for_save until after draft model forward
616f9ea0
ZhanqiuHu ZhanqiuHu force pushed to 616f9ea0 75 days ago
benchislett
benchislett commented on 2026-02-25
benchislett
benchislett
benchislett commented on 2026-02-26
NickLucche Merge branch 'main' into pd-sd-wait-for-save
22cc9624
ZhanqiuHu Merge branch 'main' into pd-sd-wait-for-save
166fd342
ZhanqiuHu Merge branch 'main' into pd-sd-wait-for-save
c53403b3
ZhanqiuHu ZhanqiuHu requested a review from njhill njhill 69 days ago
NickLucche
NickLucche approved these changes on 2026-03-03
NickLucche NickLucche added ready-run-all-tests
NickLucche Merge branch 'main' into pd-sd-wait-for-save
5be6855b
ZhanqiuHu Merge branch 'main' into pd-sd-wait-for-save
6f55ed9c
ZhanqiuHu Remove deprecated --disable-log-requests flag
d7a1b875
ZhanqiuHu Merge branch 'main' into pd-sd-wait-for-save
bf987d37
NickLucche Merge branch 'main' into pd-sd-wait-for-save
7deec211
ZhanqiuHu Merge branch 'main' into pd-sd-wait-for-save
adfb8472
NickLucche NickLucche merged 90f3c01f into main 65 days ago
hidva
hidva commented on 2026-03-22

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready ci/build v1 kv-connector ready-run-all-tests
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum