[Hardware][AMD] integrate aiter chunked prefill into vllm #18596
simon-mo
merged
20 commits into
vllm-project:main
from
ROCm:fa_upstream3
integrate aiter
d483fc2b
add env variable
4f85566f
rename function
ae85e79a
optimize kernels with small query lens
87ea0ba6
change condition
db4bc55f
Merge remote-tracking branch 'upstream/main' into fa_upstream
efe59bd2
add rocm aiter backend
40654e4e
new fa impl
8dd236d7
Zzz9990
changed the title
update api
e995fdc6
optimize performance
a501ff0c
merge
3ad9e3a3
tjtanaavllm
commented
on 2025-05-26
remove try catch
05e460fd
maleksan85
commented
on 2025-05-27
SageMoore
commented
on 2025-05-28
tjtanaa
commented
on 2025-05-28
tjtanaa
commented
on 2025-05-28
tjtanaa
commented
on 2025-05-28
gshtras
commented
on 2025-05-28
clean code
0a337a68
tjtanaa
commented
on 2025-06-02
remove type cast
5070c4b8
gshtras
commented
on 2025-06-05
Merge branch 'main' into fa_upstream3
13255d37
use on_gfx9 instead of on_mi250_mi300
7fae8df6
houseroad
approved these changes
on 2025-06-17
HAIAI
approved these changes
on 2025-06-17
disabled auto-merge 247 days ago
Manually disabled by user
Manually disabled by user
revert layernorm
2e6e0df4
SageMoore
approved these changes
on 2025-06-17
Merge remote-tracking branch 'upstream/main' into fa_upstream3
77c95e4e
fix bug
4c9bd30a
fix upstream issue
262b47f9
disabled auto-merge 246 days ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
Reviewers
Assignees
No one assigned
Labels
documentation
rocm
ready
ci/build
v1
Milestone
No milestone
Login to write a write a comment.
Login via GitHub