vllm
[Bugfix] Disable FlashInfer TRTLLM BF16 path for non-gated MoE
#36146
Merged

[Bugfix] Disable FlashInfer TRTLLM BF16 path for non-gated MoE #36146

tomeras91
tomeras91 FI-TRTLLM BF16 MoE kernels don't support non-gated MoEs, and have the…
d6effef1
tomeras91 tomeras91 requested a review from mgoin mgoin 150 days ago
tomeras91 tomeras91 requested a review from pavanimajety pavanimajety 150 days ago
mergify mergify added nvidia
mergify mergify added bug
robertgshaw2-redhat
robertgshaw2-redhat approved these changes on 2026-03-05
robertgshaw2-redhat robertgshaw2-redhat enabled auto-merge (squash) 150 days ago
gemini-code-assist
gemini-code-assist commented on 2026-03-05
github-actions github-actions added ready
vllm-bot vllm-bot merged 86483ca7 into main 150 days ago
tomeras91 tomeras91 deleted the disable-flashinfer-trtllm-bf16-non-gated-moe branch 150 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone