[ROCM] [FEAT] Integrate Aiter hipBLASLt GEMM online tuning #40426
vllm-bot
merged
33 commits into
vllm-project:main
from
aiter_hipbmm_online_tuning
Add the option to turn on hipBLASLt online tuning
a8644040
move hip_online_tuning option into serve.py
96cf2d10
use environment variable instead of CLI
d5753b3b
Merge branch 'main' into hip_online_tuning
8136fe79
fixup suffix of environment variable
7abf9162
Merge branch 'main' into hip_online_tuning
9c8fd55c
Merge branch 'main' into hip_online_tuning
838438de
Merge branch 'main' into hip_online_tuning
f6c46d1d
Merge branch 'vllm-project:main' into hip_online_tuning
6443ef95
add unit test for AITER hipBLASLt online tuning
47744cf9
fix typos in comment
eccbcede
Merge branch 'vllm-project:main' into hip_online_tuning
2e0a6a53
Merge branch 'vllm-project:main' into hip_online_tuning
f08dd937
Add AITER hipBLASLt GEMM kernel in vLLM
f33bfe55
Merge branch 'vllm-project:main' into hip_online_tuning
879ccbec
Merge branch 'main' into hip_online_tuning
7b56a010
claude
commented
on 2026-04-21
Update vllm/model_executor/kernels/linear/scaled_mm/aiter.py
ea9cef5c
Update vllm/_aiter_ops.py
d44e5b84
Remove the contiguous() after preshuffle
226e0301
tjtanaa
commented
on 2026-04-27
tjtanaa
commented
on 2026-04-27
tjtanaa
commented
on 2026-04-27
tjtanaa
commented
on 2026-04-27
tjtanaa
commented
on 2026-04-27
fix the env name and logic of aiter hipblaslt gemm and online tuning
50a8a1db
ensure VLLM_ROCM_USE_AITER_LINEAR_HIPBMM working
c4ff9255
tjtanaa
commented
on 2026-05-07
tjtanaa
commented
on 2026-05-07
tjtanaa
commented
on 2026-05-07
tjtanaa
commented
on 2026-05-07
tjtanaa
commented
on 2026-05-07
tjtanaa
commented
on 2026-05-07
tjtanaa
commented
on 2026-05-07
tjtanaa
commented
on 2026-05-07
Merge branch 'vllm-project:main' into aiter_hipbmm_online_tuning
2fdc8d0e
Change the conditions of hipblaslt online tuning
1ebc71e6
Resolve the condition of hipBLASLt online tuning
fde58786
tjtanaa
commented
on 2026-05-13
tjtanaa
commented
on 2026-05-13
tjtanaa
commented
on 2026-05-13
tjtanaa
commented
on 2026-05-13
tjtanaa
commented
on 2026-05-13
tjtanaa
commented
on 2026-05-13
Merge branch 'vllm-project:main' into aiter_hipbmm_online_tuning
46bfb7b4
fix some variable name
d0013851
fix missing line in aiter_ops
bdb9d332
tjtanaa
commented
on 2026-05-26
tjtanaa
approved these changes
on 2026-05-27
Merge branch 'main' into aiter_hipbmm_online_tuning
98ed39bf
Merge branch 'main' into aiter_hipbmm_online_tuning
30599ba8
fix pre-commit
6b52d979
Add accuracy unit-test of Aiter hipBlaslt
6c0d85e7
fix pre-commit
f6aed71f
Merge branch 'main' into aiter_hipbmm_online_tuning
df814ac0
AndreasKaratzas
approved these changes
on 2026-06-05
Reviewers
Assignees
No one assigned
Labels
rocm
ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub