PR #36307 [Perf] Add TRTLLM FP8 MoE Modular Kernel

[Perf] Add TRTLLM FP8 MoE Modular Kernel #36307

vllm-bot merged 11 commits into vllm-project:main from wzhao18:wzhao/fp8-trtllm-modular-moe

wzhao18 requested a review from

mgoin 22 days ago

wzhao18 requested a review from

pavanimajety 22 days ago

mergify added nvidia

wzhao18 force pushed from 6014cf25 to 4efbb109 22 days ago

gemini-code-assist commented on 2026-03-07

wzhao18 changed the title ~~Add TRTLLM FP8 MoE Modular Kernel~~ [Perf] Add TRTLLM FP8 MoE Modular Kernel 22 days ago

mergify added needs-rebase

Support trtllm fp8 modular kernel

9b3e8a95

Add base class for trtllm fp8 modular moe

7f0c69d7

Add base class for trtllm fp8 modular moe

20911769

Fix trtllm moe modular monolithic

6c80d32a

fix linting

469b8e5c

Revert changing minimax m2 routing logits dtype

e4545228

wzhao18 force pushed from 4efbb109 to e4545228 18 days ago

mergify removed needs-rebase

fixup

2c55cd73

wzhao18 requested a review from

LucasWilkinson 18 days ago

wzhao18 requested a review from

MatthewBonanni 18 days ago

fixup

507d3d44

mgoin added ready

Update tests

a3ab5c94

Fix gemini comments

19af1ba1

wzhao18 requested a review from

tlrmchlsmth 18 days ago

wzhao18 requested a review from

WoosukKwon 18 days ago

wzhao18 requested a review from

yewentao256 18 days ago

mgoin approved these changes on 2026-03-12

Merge branch 'main' into wzhao/fp8-trtllm-modular-moe

451172ac

vllm-bot merged 2e693f48 into main 16 days ago

Reviewers

mgoin

gemini-code-assist

pavanimajety

LucasWilkinson

MatthewBonanni

tlrmchlsmth

WoosukKwon

yewentao256

Assignees

No one assigned

Labels

ready nvidia

Milestone

No milestone

vllm [Perf] Add TRTLLM FP8 MoE Modular Kernel #36307 Merged

[Perf] Add TRTLLM FP8 MoE Modular Kernel #36307

vllm
[Perf] Add TRTLLM FP8 MoE Modular Kernel
#36307

Merged