vllm
cd0de48d - [Bugfix][V1] Free out-of-window blocks on the processed-token basis under async scheduling (#47728)

Commit
116 days ago
[Bugfix][V1] Free out-of-window blocks on the processed-token basis under async scheduling (#47728) Signed-off-by: Saddss <28726669061@qq.com> Signed-off-by: Nick Hill <nickhill123@gmail.com> Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai> Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai> Co-authored-by: Saddss <28726669061@qq.com> Co-authored-by: Nick Hill <nickhill123@gmail.com>
Author
Parents
Loading