PR #36307 [Perf] Add TRTLLM FP8 MoE Modular Kernel

Support trtllm fp8 modular kernel

wzhao18 committed 29 days ago

Add base class for trtllm fp8 modular moe

wzhao18 committed 29 days ago

Add base class for trtllm fp8 modular moe

wzhao18 committed 29 days ago

Fix trtllm moe modular monolithic

wzhao18 committed 29 days ago

fix linting

wzhao18 committed 29 days ago

Revert changing minimax m2 routing logits dtype

wzhao18 committed 29 days ago

fixup

wzhao18 committed 29 days ago

fixup

wzhao18 committed 29 days ago

Update tests

wzhao18 committed 29 days ago

Fix gemini comments

wzhao18 committed 29 days ago

Merge branch 'main' into wzhao/fp8-trtllm-modular-moe

mgoin committed 28 days ago

vllm [Perf] Add TRTLLM FP8 MoE Modular Kernel #36307 Merged