transformers
fa83baba - Fix Doge load balancing loss pairing expert loads with rank-ordered p… (#50266)

Commit

1 day ago

Fix Doge load balancing loss pairing expert loads with rank-ordered p… (#50266) Fix Doge load balancing loss pairing expert loads with rank-ordered probabilities

References

#50266 - Fix Doge load balancing loss pairing expert loads with rank-ordered p…

Author

Andreas-Hum

Parents

89e9737d

transformers fa83baba - Fix Doge load balancing loss pairing expert loads with rank-ordered p… (#50266)

transformers
fa83baba - Fix Doge load balancing loss pairing expert loads with rank-ordered p… (#50266)