vllm
[Bugfix] Fix Fp8 Triton for non-gated MoE (Nemotron)
#31983

Open

[Bugfix] Fix Fp8 Triton for non-gated MoE (Nemotron) #31983

danisereb wants to merge 2 commits into vllm-project:main from danisereb:fix_nemo_bug

gemini-code-assist commented on 2026-01-08

danisereb marked this pull request as ready for review 5 days ago

danisereb requested a review from

mgoin 5 days ago

danisereb requested a review from

robertgshaw2-redhat 5 days ago

danisereb requested a review from

tlrmchlsmth 5 days ago

danisereb requested a review from

yewentao256 5 days ago

danisereb requested a review from

pavanimajety 5 days ago

robertgshaw2-redhat changed the title ~~Fix ModelOptFp8MoEMethod for non-gated MoE (Nemotron)~~ [Bugfix] Fix ModelOptFp8MoEMethod for non-gated MoE (Nemotron) 5 days ago

robertgshaw2-redhat changed the title ~~[Bugfix] Fix ModelOptFp8MoEMethod for non-gated MoE (Nemotron)~~ [Bugfix] Fix Fp8 Triton for non-gated MoE (Nemotron) 5 days ago

LucasWilkinson dismissed these changes on 2026-01-10

LucasWilkinson dismissed their stale review 4 days ago

missed Rob's comment

danisereb force pushed from ed924368 to 4533a693 2 days ago

danisereb force pushed from 4533a693 to 85de95e2 2 days ago

cursor commented on 2026-01-11

danisereb force pushed from 85de95e2 to 360a708c 2 days ago

mergify added bug

Fix ModelOptFp8MoEMethod for non-gated MoE

5e51a9d1

Add Nemotron Nano V3 BF16 to moe-refactor evals

7d082808

danisereb force pushed from 01106194 to 7d082808 3 hours ago

Reviewers

cursor

LucasWilkinson

gemini-code-assist

mgoin

robertgshaw2-redhat

tlrmchlsmth

yewentao256

pavanimajety

Assignees

No one assigned

Labels

bug

Milestone

No milestone

vllm [Bugfix] Fix Fp8 Triton for non-gated MoE (Nemotron) #31983 Open

[Bugfix] Fix Fp8 Triton for non-gated MoE (Nemotron) #31983

vllm
[Bugfix] Fix Fp8 Triton for non-gated MoE (Nemotron)
#31983

Open