vllm
[ROCm] Fix aiter persistent mode mla with q/o nhead<16 for kimi-k2.5 tp8
#38615

Merged

[ROCm] Fix aiter persistent mode mla with q/o nhead<16 for kimi-k2.5 tp8 #38615

vllm-bot merged 2 commits into vllm-project:main from wufann:kimi_ps_mla_head

[ROCm] Fix aiter persistent mode mla with nhead<16 for kimi-k2.5 tp8

d7342a05

wufann requested a review from

tjtanaa 124 days ago

mergify added rocm

mergify added v1

gemini-code-assist commented on 2026-03-31

tjtanaa dismissed these changes on 2026-04-02

tjtanaa dismissed their stale review 122 days ago

Require additional changes

Update vllm/v1/attention/backends/mla/rocm_aiter_mla.py

4ae1d3e7

tjtanaa approved these changes on 2026-04-03

tjtanaa added ready

vllm-bot merged 1b117cb0 into main 121 days ago

Reviewers

tjtanaa

gemini-code-assist

Assignees

No one assigned

Labels

rocm ready v1

Milestone

No milestone