vllm
[Bugfix][ROCm] Use `chunked_prefill_paged_decode` as fallback for V1 attention on ROCm
#18093

Merged

[Bugfix][ROCm] Use `chunked_prefill_paged_decode` as fallback for V1 attention on ROCm #18093

vllm-bot merged 2 commits into vllm-project:main from EmbeddedLLM:fallback-v1-paged-attn

fallback v1 FA to chunked_prefill_paged_decode

6ee82224

fallback v1 FA to chunked_prefill_paged_decode

93952cb0

kliuae requested a review from

WoosukKwon 1 year ago

kliuae requested a review from

robertgshaw2-redhat 1 year ago

kliuae requested a review from

njhill 1 year ago

kliuae requested a review from

ywang96 1 year ago

kliuae requested a review from

comaniac 1 year ago

kliuae requested a review from

alexm-redhat 1 year ago

mergify added v1

houseroad added rocm

hongxiayang approved these changes on 2025-05-15

DarkLight1337 approved these changes on 2025-05-15

DarkLight1337 enabled auto-merge (squash) 1 year ago

github-actions added ready

DarkLight1337 added this to the v0.9.0 milestone 1 year ago

disabled auto-merge 1 year ago
Manually disabled by user

vllm-bot merged ee659e3b into main 1 year ago

tjtanaa deleted the fallback-v1-paged-attn branch 198 days ago

Reviewers

DarkLight1337

hongxiayang

WoosukKwon

robertgshaw2-redhat

njhill

ywang96

comaniac

alexm-redhat

Assignees

No one assigned

Labels

rocm ready v1

Milestone

v0.9.0