vllm
[ROCm][Perf] New design on ROCm AITER MHA backend Implementation
#25763
Merged
Merged
[ROCm][Perf] New design on ROCm AITER MHA backend Implementation #25763
simon-mo
merged
6 commits into
vllm-project:main
from
ROCm:ganyi/refactor_attn_backend_impl_main
ganyi1996ppo
changed the title 
wuhuikx
requested changes
on 2025-09-27
shajrawi
commented
on 2025-10-13
LucasWilkinson
dismissed these changes
on 2025-10-14
LucasWilkinson
commented
on 2025-10-14
HAIAI
requested changes
on 2025-10-20
HAIAI
commented
on 2025-10-22
HAIAI
approved these changes
on 2025-10-22
wuhuikx
approved these changes
on 2025-10-27
LucasWilkinson
dismissed their stale review
198 days ago
> > Apologies silly bugs 🤦; does this work for you? #27739
>
>
>
> @LucasWilkinson , this fix works fine on my environment, thanks!
>
Thanks for testing that! Appreciate all the back and forth, and patience!
Once that lands this PR should be purely in the rocm/AITER backend so should be quick to review and get in. I am OOO this week (despite being online more than I intended haha); I'll try to do the final review. Otherwise @gshtras can also review it as the AMD code owner (now that it's purely an AMD change)
houseroad
approved these changes
on 2025-11-04
refactor attention backend for perf boost
acb8be56
fix full graph
bef4be24
rebase main
7fff76fa
rebase main
fbaae7a5
resolve comments
6f4266f6
resolve comments
39aa18dd
gshtras
approved these changes
on 2025-11-04
Login to write a write a comment.
Reviewers
Assignees
Labels
rocm
ready
ci/build
v1
Milestone
No milestone