vllm
90f3c01f
- [Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
59 days ago
[Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158) Signed-off-by: Claude <noreply@anthropic.com> Signed-off-by: Zhanqiu Hu <zh338@cornell.edu> Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
References
#35158 - [Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding
Author
ZhanqiuHu
Parents
807d6803
Loading