vllm
[ROCm][Aiter] Add triton fp8 bmm kernel for mla
#23264
Merged
Overview
Commits
14
Changes
View On GitHub

[ROCm][Aiter] Add triton fp8 bmm kernel for mla #23264

gshtras merged 14 commits into vllm-project:main from divakar-amd:aiter_bmm_fp8
divakar-amd
k50112113 add fused fp8 bmm
6d7840c3
k50112113 add envs
92e134a0
divakar-amd api fix for upstream compatibility
9433b841
divakar-amd improve env switch. reformat lint
245f2eb1
divakar-amd nit: formatting and direct aiter fxn call
6fd99d2f
divakar-amd fit fp8 dtype selection
c219220e
divakar-amd rm kernel warmup
8017d7d7
divakar-amd Merge branch 'vllm-project:main' into aiter_bmm_fp8
b0ae8579
divakar-amd divakar-amd requested a review from WoosukKwon WoosukKwon 168 days ago
divakar-amd divakar-amd requested a review from robertgshaw2-redhat robertgshaw2-redhat 168 days ago
divakar-amd divakar-amd requested a review from njhill njhill 168 days ago
divakar-amd divakar-amd requested a review from ywang96 ywang96 168 days ago
divakar-amd divakar-amd requested a review from comaniac comaniac 168 days ago
divakar-amd divakar-amd requested a review from alexm-redhat alexm-redhat 168 days ago
github-actions
mergify mergify added rocm
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2025-08-20
divakar-amd add AITER FP8BMM to env hash list
8193c6d7
divakar-amd add pre-compilation for the triton BMM kernel
e8fe370f
divakar-amd Merge branch 'main' into aiter_bmm_fp8
87a52393
SageMoore
SageMoore commented on 2025-08-25
SageMoore
SageMoore approved these changes on 2025-08-26
divakar-amd Merge branch 'main' into aiter_bmm_fp8
63a47011
divakar-amd Merge branch 'main' into aiter_bmm_fp8
06a953ad
ProExpertProg ProExpertProg added ready
gshtras gshtras enabled auto-merge (squash) 160 days ago
divakar-amd Merge branch 'main' into aiter_bmm_fp8
92bf5c8e
gshtras
gshtras approved these changes on 2025-08-28
gshtras gshtras merged 04d1dd7f into main 159 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
rocm ready v1
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum