vllm
90f3c01f - [Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158)

Commit
59 days ago
[Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158) Signed-off-by: Claude <noreply@anthropic.com> Signed-off-by: Zhanqiu Hu <zh338@cornell.edu> Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Author
Parents
Loading