[Core] FlashInfer CUTLASS fused MoE backend (NVFP4) #20037
simon-mo
merged
34 commits into
vllm-project:main
from
wenscarl:flashinfer_fused_moe
gemini-code-assist
commented
on 2025-06-24
bnellnm
commented
on 2025-06-27
bnellnm
commented
on 2025-06-27
bnellnm
commented
on 2025-06-27
Flashinfer cutlass moe backend for TP/DP + EP.
7cdb8002
cutlass mooe path work
11f91362
flashinfer tp pass
92994d53
dp work
93a3a0a6
Clean up
c1a74ebb
Fix NoEP class
f4dc86bf
Fix NoEP class
7df49e19
chunking work
5af3db95
Address comments
4c5fa6dc
wenscarl
changed the title
minor fix
f99cf65e
cutlass_moe_fp4 support TP chunking
dbefd52c
flahinfer cutlass moe support TP chunking
3f043ddf
Address comment and clean Up
7b5e203f
Merge remote-tracking branch 'origin/main' into flashinfer_fused_moe
248fff32
mgoin
changed the title
Upd
131f1414
Merge remote-tracking branch 'origin/main' into flashinfer_fused_moe
e5403e56
Fix lint
3bdbeb1e
Merge Pynccl ag/rs
8fdb3dc5
Recover apply_router_weight_on_input
5bcd50bf
Merge remote-tracking branch 'origin/main' into flashinfer_fused_moe
b8422454
remove comment
6fed4949
fix lint
20f3417d
mgoin
commented
on 2025-07-15
Add autotune
728275bc
Add flashinfer wrapper and fix pre-commit
bbb505f7
mgoin
commented
on 2025-07-16
Move switch w13 to modelopt
841fcd1f
mgoin
commented
on 2025-07-16
Address comments.
716621ae
Upd
f31be5a8
Upd
62256705
fix interface changes
a08b47f7
Merge remote-tracking branch 'origin/main' into flashinfer_fused_moe
881684ff
mgoin
commented
on 2025-07-17
Upd
24ce9aaa
Fix run_cutlass_moe_fp4 for Llama 4
e5d14ea6
mgoin
approved these changes
on 2025-07-17
Ensure lazy imports for flashinfer
4b3ee2e7
Just use has_flashinfer in fused_moe/layer.py
cc0e87d8
Reviewers
Assignees
No one assigned
Labels
performance
ready
ci/build
v1
deepseek
Milestone
Login to write a write a comment.
Login via GitHub