vllm
a66cf40b - [Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927)

Commit

1 year ago

[Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927) This PR enables the fused topk_softmax kernel used in moe layer for HIP

References

Author

divakar-amd

Parents