vllm
[Bugfix] Fix NVFP4 TRTLLM MoE non-gated support; add gsm8k for Nemotron-3-Nano FP8+NVFP4
#34725

Merged

[Bugfix] Fix NVFP4 TRTLLM MoE non-gated support; add gsm8k for Nemotron-3-Nano FP8+NVFP4 #34725

vllm-bot merged 4 commits into vllm-project:main from neuralmagic:nemotron-h-trtllm-nvfp4-test

Add GSM8k test for Nemotron-Nano-30B-NvFp4-fi-trtllm

a6557bdc

mergify added nvidia

gemini-code-assist commented on 2026-02-17

Update to general test

f4889617

Fix nvfp4 and add fp8 trtllm

b357be6d

mgoin requested a review from

robertgshaw2-redhat 82 days ago

mgoin requested a review from

tlrmchlsmth 82 days ago

mgoin requested a review from

yewentao256 82 days ago

mgoin requested a review from

pavanimajety 82 days ago

mgoin changed the title ~~Add GSM8k test for Nemotron-Nano-30B-NvFp4-fi-trtllm~~ Fix NVFP4 TRTLLM MoE non-gated support; add gsm8k for Nemotron-3-Nano FP8+NVFP4 82 days ago

robertgshaw2-redhat commented on 2026-02-17

mgoin added bug

mgoin added ready

Fix env

37d5fbcb

robertgshaw2-redhat approved these changes on 2026-02-17

robertgshaw2-redhat enabled auto-merge (squash) 81 days ago

mgoin changed the title ~~Fix NVFP4 TRTLLM MoE non-gated support; add gsm8k for Nemotron-3-Nano FP8+NVFP4~~ [Bugfix] Fix NVFP4 TRTLLM MoE non-gated support; add gsm8k for Nemotron-3-Nano FP8+NVFP4 81 days ago

vllm-bot merged caeb887b into main 81 days ago

Reviewers

robertgshaw2-redhat

gemini-code-assist

tlrmchlsmth

yewentao256

pavanimajety

Assignees

No one assigned

Labels

bug ready nvidia

Milestone

No milestone

vllm [Bugfix] Fix NVFP4 TRTLLM MoE non-gated support; add gsm8k for Nemotron-3-Nano FP8+NVFP4 #34725 Merged

[Bugfix] Fix NVFP4 TRTLLM MoE non-gated support; add gsm8k for Nemotron-3-Nano FP8+NVFP4 #34725

vllm
[Bugfix] Fix NVFP4 TRTLLM MoE non-gated support; add gsm8k for Nemotron-3-Nano FP8+NVFP4
#34725

Merged