vllm
66dfee71 - [Bugfix] Fix degenerate KV cache stride causing TMA cudaErrorIllegalInstruction (#40737)

Commit
175 days ago
[Bugfix] Fix degenerate KV cache stride causing TMA cudaErrorIllegalInstruction (#40737) Signed-off-by: David Oy <david@baseten.co> Signed-off-by: David Oy <58150256+the-david-oy@users.noreply.github.com> Signed-off-by: David Oy <david.oy@baseten.co> Co-authored-by: David Oy <david@baseten.co> Co-authored-by: Claude <claude@anthropic.com> Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
Author
Parents
Loading