vllm
dynamic distpatch of fp8 kernels
#14245
Merged
Overview
Commits
12
Changes
View On GitHub

dynamic distpatch of fp8 kernels #14245

robertgshaw2-redhat merged 12 commits into vllm-project:main from ROCm:is_fp8_fnuz
jeffdaily
jeffdaily dynamic distpatch of fp8 kernels
77217893
jeffdaily jeffdaily requested a review from mgoin mgoin 1 year ago
jeffdaily jeffdaily requested a review from robertgshaw2-redhat robertgshaw2-redhat 1 year ago
jeffdaily jeffdaily requested a review from tlrmchlsmth tlrmchlsmth 1 year ago
jeffdaily jeffdaily requested a review from WoosukKwon WoosukKwon 1 year ago
github-actions
mergify
mergify mergify added needs-rebase
jeffdaily Merge branch 'main' into is_fp8_fnuz
0bc4a2c3
jeffdaily jeffdaily force pushed to 0bc4a2c3 1 year ago
mergify mergify removed needs-rebase
jeffdaily lint
d017db21
ProExpertProg
ProExpertProg requested changes on 2025-03-06
jeffdaily add current_platform.fp8_dtype()
32699468
jeffdaily requested changes
14372675
jeffdaily more suggested changes
376449a1
jeffdaily nested dispatch
5c3329d6
jeffdaily
jeffdaily jeffdaily requested a review from ProExpertProg ProExpertProg 1 year ago
ProExpertProg
ProExpertProg approved these changes on 2025-03-07
tlrmchlsmth
tlrmchlsmth commented on 2025-03-07
jeffdaily additional reviewer requests
27395bbf
jeffdaily
ProExpertProg
hongxiayang hongxiayang added rocm
jeffdaily conditionally add back C10_HOST_DEVICE for fp8 max
1cfa515e
ProExpertProg
robertgshaw2-redhat robertgshaw2-redhat added ready
robertgshaw2-redhat robertgshaw2-redhat removed ready
jeffdaily revert removal of current_platform_fp8_dtype
b90114a8
jeffdaily
ProExpertProg
ProExpertProg
ProExpertProg commented on 2025-03-10
jeffdaily remove current_platform_fp8_dtype
1330334f
jeffdaily jeffdaily requested a review from njhill njhill 1 year ago
jeffdaily jeffdaily requested a review from ywang96 ywang96 1 year ago
jeffdaily jeffdaily requested a review from comaniac comaniac 1 year ago
jeffdaily jeffdaily requested a review from alexm-redhat alexm-redhat 1 year ago
mergify mergify added v1
mergify
mergify mergify added needs-rebase
jeffdaily Merge branch 'main' into is_fp8_fnuz
ed8ec2a5
mergify mergify removed needs-rebase
ProExpertProg
ProExpertProg approved these changes on 2025-03-11
robertgshaw2-redhat robertgshaw2-redhat added ready
robertgshaw2-redhat
robertgshaw2-redhat approved these changes on 2025-03-11
tlrmchlsmth
tlrmchlsmth approved these changes on 2025-03-11
robertgshaw2-redhat robertgshaw2-redhat merged a1c8f379 into main 1 year ago
ProExpertProg
jeffdaily
ProExpertProg
jeffdaily
ProExpertProg
jeffdaily
ProExpertProg
jeffdaily

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
rocm ready v1
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum