vllm
0bfeb8d0 - [Bugfix][Spec Decode] DFlash/DSpark no longer drop the last prefix-cache block (mamba align context recompute) (#54163)

Commit
1 day ago
[Bugfix][Spec Decode] DFlash/DSpark no longer drop the last prefix-cache block (mamba align context recompute) (#54163) Signed-off-by: ouzq <ouzq@seu.edu.cn> Signed-off-by: zjy0516 <riverclouds.zhu@qq.com> Co-authored-by: OpenAI Codex <noreply@openai.com> Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Author
Parents
Loading