text-generation-inference
Update vllm kernels for ROCM
#2826
Merged

Update vllm kernels for ROCM #2826

Narsil merged 6 commits into main from update_rocm_vllm_kernels
mht-sharma
mht-sharma (vllm) updated vllm rocm kernels
2cca808c
mht-sharma revert silu
ca071bdd
mht-sharma update partition size
07e9ec2b
mht-sharma remove grouped_topk
1194cdb1
mht-sharma mht-sharma requested a review from danieldk danieldk 1 year ago
mht-sharma mht-sharma requested a review from Narsil Narsil 1 year ago
mht-sharma (nit) remove log
999eba80
mht-sharma update moe-kernels commit
a0c70ca0
Narsil
Narsil approved these changes on 2024-12-18
Narsil Narsil merged 8f66d323 into main 1 year ago
Narsil Narsil deleted the update_rocm_vllm_kernels branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone