vllm
[2/N][Attention] Enable masked MHA for sparse MLA prefills
#48770
Merged
Overview
Commits
28
Changes
View On GitHub

[2/N][Attention] Enable masked MHA for sparse MLA prefills #48770

vllm-bot merged 28 commits into vllm-project:main from MatthewBonanni:fa4_masked_mha_remainder
MatthewBonanni
MatthewBonanni [Attention] Add masked MHA path for sparse MLA
2721e26e
mergify mergify added ci/build
mergify mergify added performance
mergify mergify added v1
MatthewBonanni Fix IMA
e2b53b62
MatthewBonanni Clean up padding
3008fccd
mergify
mergify mergify added needs-rebase
MatthewBonanni Merge branch 'main' into fa4_masked_mha_remainder
b47873f8
mergify mergify removed needs-rebase
MatthewBonanni Chunked context support
15d69990
MatthewBonanni Reuse global topk mask
a3ca0e20
MatthewBonanni Remove block sparse stuff
1a37b3c0
MatthewBonanni Add heuristic
c19aa023
mergify
mergify mergify added needs-rebase
MatthewBonanni Merge branch 'main' into fa4_masked_mha_remainder
81ec3e4c
mergify mergify removed needs-rebase
MatthewBonanni MatthewBonanni marked this pull request as ready for review 109 days ago
MatthewBonanni MatthewBonanni requested a review from tlrmchlsmth tlrmchlsmth 109 days ago
MatthewBonanni MatthewBonanni requested a review from LucasWilkinson LucasWilkinson 109 days ago
MatthewBonanni MatthewBonanni requested a review from Harry-Chen Harry-Chen 109 days ago
claude
claude commented on 2026-07-17
MatthewBonanni Merge branch 'main' into fa4_masked_mha_remainder
08524a04
mergify
mergify mergify added needs-rebase
MatthewBonanni Merge branch 'main' into fa4_masked_mha_remainder
65623106
mergify mergify removed needs-rebase
LucasWilkinson
LucasWilkinson commented on 2026-07-26
MatthewBonanni Merge branch 'main' into fa4_masked_mha_remainder
512b29be
MatthewBonanni Review comment
cfc29572
MatthewBonanni Cleanup
25e05283
MatthewBonanni Cleanup
b09ba1de
mergify
mergify mergify added needs-rebase
LucasWilkinson
LucasWilkinson commented on 2026-07-28
LucasWilkinson
LucasWilkinson commented on 2026-07-28
LucasWilkinson
LucasWilkinson commented on 2026-07-28
LucasWilkinson
LucasWilkinson commented on 2026-07-28
LucasWilkinson
LucasWilkinson approved these changes on 2026-07-28
MatthewBonanni Merge branch 'main' into fa4_masked_mha_remainder
f17b1a77
MatthewBonanni Cleanup
7a0c45ad
MatthewBonanni Cleanup
c68f1a15
MatthewBonanni Cleanup, break out helper
8e1241a3
MatthewBonanni Preallocate topk mask buffer
002ed43a
mergify mergify removed needs-rebase
MatthewBonanni MatthewBonanni added ready
MatthewBonanni MatthewBonanni added needs-rebase
mergify mergify removed needs-rebase
MatthewBonanni MatthewBonanni changed the title [2/N][Attention] Enable masked MHA for sparse MLA prefills [Do Not Merge][2/N][Attention] Enable masked MHA for sparse MLA prefills 97 days ago
MatthewBonanni
MatthewBonanni Gate workspace allocation on masked mha availability
247048e1
MatthewBonanni Clean up gate and heuristic
c2664728
MatthewBonanni Fix tests
e8f35075
MatthewBonanni update FA
34a709f4
MatthewBonanni Zero in kernel
5722c833
MatthewBonanni update FA
8d44a984
MatthewBonanni update FA after landing
469862e4
MatthewBonanni Merge branch 'main' into fa4_masked_mha_remainder
6338c213
MatthewBonanni MatthewBonanni enabled auto-merge (squash) 96 days ago
MatthewBonanni MatthewBonanni changed the title [Do Not Merge][2/N][Attention] Enable masked MHA for sparse MLA prefills [2/N][Attention] Enable masked MHA for sparse MLA prefills 96 days ago
mgoin
mgoin approved these changes on 2026-07-31
vllm-bot vllm-bot merged 82ae4164 into main 95 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
performance ready ci/build v1
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum