PR #24966 [Bugfix][B200] Fix `cutlass_mla` hang

[Bugfix][B200] Fix `cutlass_mla` hang #24966

mgoin merged 3 commits into main from fix_kv_split

alexm-redhat requested a review from

mgoin 322 days ago

alexm-redhat requested a review from

robertgshaw2-redhat 322 days ago

mergify added documentation

mergify added ci/build

mergify added rocm

alexm-redhat assigned

alexm-redhat 322 days ago

gemini-code-assist commented on 2025-09-16

alexm-redhat force pushed 322 days ago

alexm-redhat force pushed to 37f1a092 322 days ago

robertgshaw2-redhat changed the title ~~[Bugfix] Fix cutlass_mla hang for large batch size by limiting the kv…~~ [Bugfix][B200] Fix `cutlass_mla` hang 322 days ago

mgoin added ready

mgoin added deepseek

mgoin removed documentation

mgoin removed rocm

mgoin removed ci/build

mgoin added bug

alexm-redhat force pushed from 37f1a092 322 days ago

alexm-redhat force pushed 322 days ago

[Bugfix] Fix hanging issue with cutlass_mla by limiting the kv_split …

2975c3fc

alexm-redhat force pushed to 2975c3fc 322 days ago

Merge branch 'main' into fix_kv_split

7f220061

Merge branch 'main' into fix_kv_split

9850284e

mgoin approved these changes on 2025-09-17

mgoin merged fedb75fa into main 321 days ago

mgoin deleted the fix_kv_split branch 321 days ago

Reviewers

mgoin

gemini-code-assist

robertgshaw2-redhat

Assignees

alexm-redhat

Labels

bug ready deepseek

Milestone

No milestone

vllm [Bugfix][B200] Fix `cutlass_mla` hang #24966 Merged

[Bugfix][B200] Fix `cutlass_mla` hang #24966

vllm
[Bugfix][B200] Fix `cutlass_mla` hang
#24966

Merged