vllm
[ROCm][MLA][Bugfix] Reserve FP8 prefill workspace before lock for Kimi-K2.5
#42978
Merged

[ROCm][MLA][Bugfix] Reserve FP8 prefill workspace before lock for Kimi-K2.5 #42978

xaguilar-amd
xaguilar-amd Fixes a ROCm AITER dense MLA FP8 prefill crash where the per-call scr…
3f08ba1d
xaguilar-amd xaguilar-amd marked this pull request as ready for review 168 days ago
xaguilar-amd xaguilar-amd requested a review from tjtanaa tjtanaa 168 days ago
gemini-code-assist
gemini-code-assist commented on 2026-05-18
mergify mergify added rocm
mergify mergify added v1
mergify mergify added bug
xaguilar-amd Adressed a Gemini comment about the understimation of the amount rese…
9c63edf5
xaguilar-amd xaguilar-amd changed the title [ROCm][MLA][BUG] Reserve FP8 prefill workspace before lock for Kimi-K2.5 [ROCm][MLA][Bugfix] Reserve FP8 prefill workspace before lock for Kimi-K2.5 168 days ago
okorzh-amd
okorzh-amd
Rohan138
Rohan138 commented on 2026-05-27
xaguilar-amd Address Rohan's nit: reduce_partial_map_size is always an int
7c39d0af
xaguilar-amd xaguilar-amd requested a review from AndreasKaratzas AndreasKaratzas 158 days ago
AndreasKaratzas AndreasKaratzas added ready
micah-wil
micah-wil approved these changes on 2026-06-02
pschlan-amd
tjtanaa
tjtanaa commented on 2026-06-03
dllehr-amd
dllehr-amd requested changes on 2026-06-03
xaguilar-amd [ROCm][MLA][Bugfix] Address review: drop hot-path refactor, fix final…
f0334982
xaguilar-amd xaguilar-amd requested a review from dllehr-amd dllehr-amd 150 days ago
dllehr-amd
dllehr-amd approved these changes on 2026-06-05
dllehr-amd Merge branch 'main' into fix_mla_ps_prefill_bug
daf7688d
xaguilar-amd xaguilar-amd requested a review from tjtanaa tjtanaa 150 days ago
fxmarty-amd
fxmarty-amd approved these changes on 2026-06-05
AndreasKaratzas Merge branch 'main' into fix_mla_ps_prefill_bug
366c146a
vllm-bot vllm-bot merged baacbfce into main 146 days ago
AndreasKaratzas AndreasKaratzas added this to the v0.23.0 cherry picks milestone 145 days ago
AndreasKaratzas

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels