[Performance][Kernel] Fused_moe Performance Improvement #9384
simon-mo
merged
7 commits into
vllm-project:main
from
charlifu:moe_opt
comaniac
approved these changes
on 2024-10-18
tlrmchlsmth
approved these changes
on 2024-10-18
add moe_sum and improve the thread number of moe align
34d4ea6a
linting
2f0fef9c
linting
7bd636f1
fix unit test
cf2c9900
Merge branch 'vllm-project:main' into moe_opt
73fc6384
fix num_expert 64
4e5bd495
cast to in32
04af8129
Reviewers
Assignees
No one assigned
Labels
ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub