vllm
[Bugfix] Fix degenerate KV cache stride causing TMA cudaErrorIllegalInstruction
#40737
Merged
Overview
Commits
10
Changes
View On GitHub

[Bugfix] Fix degenerate KV cache stride causing TMA cudaErrorIllegalInstruction #40737

robertgshaw2-redhat merged 10 commits into vllm-project:main from the-david-oy:fix/tma-kv-head-stride-degenerate
the-david-oy
the-david-oy the-david-oy requested a review from mgoin mgoin 192 days ago
the-david-oy the-david-oy requested a review from pavanimajety pavanimajety 192 days ago
the-david-oy the-david-oy requested a review from vadiklyutiy vadiklyutiy 192 days ago
the-david-oy the-david-oy requested a review from LucasWilkinson LucasWilkinson 192 days ago
the-david-oy the-david-oy requested a review from MatthewBonanni MatthewBonanni 192 days ago
claude
claude commented on 2026-04-23
github-actions
the-david-oy the-david-oy changed the title [Bugfix] Fix degenerate KV cache stride causing TMA cudaErrorIllegalI… [Bugfix] Fix degenerate KV cache stride causing TMA cudaErrorIllegalInstruction 192 days ago
mergify mergify added nvidia
mergify mergify added v1
mergify mergify added bug
gemini-code-assist
gemini-code-assist commented on 2026-04-23
vadiklyutiy
the-david-oy the-david-oy force pushed from c9e24797 191 days ago
[Bugfix] Fix degenerate KV cache stride causing TMA cudaErrorIllegalI…
a25ecacf
the-david-oy the-david-oy force pushed to a25ecacf 191 days ago
the-david-oy
the-david-oy
vadiklyutiy
vadiklyutiy
vadiklyutiy
vadiklyutiy commented on 2026-04-27
the-david-oy Accurately set strides for non-contiguous tensors
5e7536b5
the-david-oy the-david-oy force pushed 187 days ago
the-david-oy Address review: clarify size=1 wording, revert incidental assert refo…
d1863ebd
the-david-oy the-david-oy force pushed to d1863ebd 187 days ago
vadiklyutiy
vadiklyutiy commented on 2026-04-28
the-david-oy Address review: replace reshape with canonicalize_singleton_dim_strid…
a19353e5
the-david-oy Address review: replace kv stride assertions with canonicalize_single…
3d3bbb5d
the-david-oy
the-david-oy the-david-oy requested a review from vadiklyutiy vadiklyutiy 186 days ago
the-david-oy
vadiklyutiy
vadiklyutiy vadiklyutiy added verified
vadiklyutiy
vadiklyutiy requested changes on 2026-04-30
mergify
the-david-oy
the-david-oy Address review: split contiguous + canonicalize into sequential state…
1b9b963a
mergify
the-david-oy Merge branch 'main' into fix/tma-kv-head-stride-degenerate
122283ba
mergify
the-david-oy Fix missing logger in flash_attn_diffkv and mypy sched_getaffinity
2a52c1d1
mergify mergify added cpu
mergify
the-david-oy the-david-oy requested a review from vadiklyutiy vadiklyutiy 185 days ago
robertgshaw2-redhat robertgshaw2-redhat added ready
mgoin
mgoin commented on 2026-05-01
the-david-oy Address review: shorten docstring, restore inner-dim assertions, add …
9ad88833
vadiklyutiy
vadiklyutiy approved these changes on 2026-05-03
vadiklyutiy Merge branch 'main' into fix/tma-kv-head-stride-degenerate
dbc2ca72
robertgshaw2-redhat robertgshaw2-redhat enabled auto-merge (squash) 182 days ago
robertgshaw2-redhat robertgshaw2-redhat merged 66dfee71 into main 182 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
bug ready v1 cpu nvidia verified
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum