vllm
[Bugfix] Zero-init MLA attention output buffers to prevent NaN from CUDA graph padding
#37442

Merged

[Bugfix] Zero-init MLA attention output buffers to prevent NaN from CUDA graph padding #37442

tlrmchlsmth merged 4 commits into vllm-project:main from elvircrn:zero-init-attn-output-pr

elvircrn requested a review from

pavanimajety 137 days ago

mergify added nvidia

mergify added v1

mergify added bug

elvircrn force pushed 137 days ago

gemini-code-assist commented on 2026-03-18

elvircrn force pushed 137 days ago

[Bugfix] Zero-init attention output buffers to prevent NaN from CUDA …

fe46b004

elvircrn force pushed to fe46b004 137 days ago

tlrmchlsmth added ready

Fix FlashInfer MLA output buffer shape for multi-token queries (spec …

62b4a62a

Fix FlashInfer MLA: only pass out= for single-token decode

c61c998c

Zero after kernel for q_len > 1

ac29832e

tlrmchlsmth approved these changes on 2026-03-18

tlrmchlsmth enabled auto-merge (squash) 137 days ago

tlrmchlsmth assigned

tlrmchlsmth 137 days ago

tlrmchlsmth merged ef2c4f77 into main 137 days ago

Reviewers

tlrmchlsmth

gemini-code-assist

pavanimajety

Assignees

tlrmchlsmth

Labels

bug ready v1 nvidia

Milestone

No milestone