vllm
01fb22ee - [ROCm][Bugfix] Null stale block-table entries after the KV cache sizing shrink (#67966)

Commit
11 hours ago
[ROCm][Bugfix] Null stale block-table entries after the KV cache sizing shrink (#67966) Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com> Signed-off-by: Andreas Karatzas <akaratza@amd.com> Co-authored-by: Andreas Karatzas <akaratza@amd.com> Co-authored-by: Claude <noreply@anthropic.com> Co-authored-by: vllm-agent <claw@inferact.ai>
Parents
Loading