PR #43445 Fix some MoE routers

Fix some MoE routers #43445

vasqu merged 8 commits into main from fix-broken-eager-experts

fix routers that returned the entire distribution of experts

4a435530

add comment

1b7f9a0a

IlyasMoutawwakil commented on 2026-01-23

IlyasMoutawwakil commented on 2026-01-26

Merge branch 'main' into fix-broken-eager-experts

8d784968

fix broken phimoe rope

ceba5d10

fix phimoe

ed48f490

hunyuan_v1_moe integration tests passing

780e03b4

IlyasMoutawwakil commented on 2026-01-26

IlyasMoutawwakil requested a review from

ArthurZucker 175 days ago

IlyasMoutawwakil requested a review from

vasqu 175 days ago

IlyasMoutawwakil requested a review from

Rocketknight1 175 days ago

vasqu approved these changes on 2026-01-26

revert logits and use eager

6a6263bc

Merge branch 'main' into fix-broken-eager-experts

6cfe8408

IlyasMoutawwakil commented on 2026-01-27

vasqu merged 0dbb56e3 into main 174 days ago

vasqu deleted the fix-broken-eager-experts branch 174 days ago

Reviewers

vasqu

ArthurZucker

Rocketknight1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone