transformers
[Trainer] Preserve MoE router auxiliary loss with label smoothing
#51083
Open

[Trainer] Preserve MoE router auxiliary loss with label smoothing #51083

taking-lying-flat
taking-lying-flat Fix Trainer label smoothing dropping MoE router loss
6fbf583e
taking-lying-flat Simplify MoE label smoothing regression test
ce42eccf
taking-lying-flat Reuse Qwen3-MoE tester configuration in Trainer regression
ea80a09e
taking-lying-flat Preserve full router loss during evaluation
7af64c04
taking-lying-flat Simplify auxiliary loss scaling and regression setup
d2f20afc
taking-lying-flat Focus label smoothing regression on distinct loss paths
66e037f1

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone