[Bugfix] Disable FlashInfer TRTLLM BF16 path for non-gated MoE #36146
FI-TRTLLM BF16 MoE kernels don't support non-gated MoEs, and have theā¦
d6effef1
vllm-bot
merged
86483ca7
into main 150 days ago
tomeras91
deleted the disable-flashinfer-trtllm-bf16-non-gated-moe branch 150 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub