transformers
[`SwitchTransformer`] Significant performance improvement on MoE blocks
#31173
Merged

[`SwitchTransformer`] Significant performance improvement on MoE blocks #31173

ranggihwang
younesbelkada
younesbelkada commented on 2024-06-03
younesbelkada younesbelkada requested a review from ArthurZucker ArthurZucker 1 year ago
ranggihwang
younesbelkada
ranggihwang
younesbelkada
amyeroberts
younesbelkada
ranggihwang SwitchTransformer MoE layer performance improvement
4965da6f
ranggihwang ranggihwang force pushed to 4965da6f 1 year ago
ranggihwang
younesbelkada
ranggihwang make fixup
8e5bb3db
ranggihwang
younesbelkada
younesbelkada approved these changes on 2024-06-03
HuggingFaceDocBuilderDev
younesbelkada younesbelkada requested a review from amyeroberts amyeroberts 1 year ago
ArthurZucker
ArthurZucker
ArthurZucker commented on 2024-06-03
ranggihwang comments about shapes
3459299e
ranggihwang make fixup
590cd13c
ranggihwang
ranggihwang ranggihwang changed the title Significant performance improvement on MoE blocks of SwitchTransformer [`SwitchTransformer`] Significant performance improvement on MoE blocks of SwitchTransformer 1 year ago
ranggihwang ranggihwang changed the title [`SwitchTransformer`] Significant performance improvement on MoE blocks of SwitchTransformer [`SwitchTransformer`] Significant performance improvement on MoE blocks 1 year ago
ranggihwang ranggihwang requested a review from younesbelkada younesbelkada 1 year ago
ranggihwang ranggihwang requested a review from ArthurZucker ArthurZucker 1 year ago
younesbelkada
younesbelkada approved these changes on 2024-06-04
ArthurZucker
ArthurZucker approved these changes on 2024-06-06
ArthurZucker ArthurZucker merged 9b85e405 into main 1 year ago
ArthurZucker
ranggihwang
ArthurZucker

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone