vllm
[NemotronH] Do not force router to run in fp32
#34582

Merged

[NemotronH] Do not force router to run in fp32 #34582

vllm-bot merged 4 commits into vllm-project:main from roikoren755:feat/nemotronh-bf16-router

roikoren755 requested a review from

mgoin 83 days ago

roikoren755 requested a review from

pavanimajety 83 days ago

Do not force NemotronH router to fp32

608fbdf3

Fix router logits dtype mismatch

48ab68e2

roikoren755 force pushed to 48ab68e2 83 days ago

mergify added nvidia

gemini-code-assist commented on 2026-02-15

tomeras91 commented on 2026-02-15

Delete debugging print

8301f2cd

Remove unnecessary .to call

7e58b855

mgoin approved these changes on 2026-02-16

mgoin added performance

mgoin added ready

vllm-bot merged 3b30e615 into main 82 days ago

roikoren755 deleted the feat/nemotronh-bf16-router branch 81 days ago

Reviewers

mgoin

tomeras91

gemini-code-assist

pavanimajety

Assignees

No one assigned

Labels

performance ready nvidia

Milestone

No milestone