transformers

9b85e405 - [`SwitchTransformer`] Significant performance improvement on MoE blocks (#31173)

[`SwitchTransformer`] Significant performance improvement on MoE blocks (#31173) * SwitchTransformer MoE layer performance improvement * make fixup * comments about shapes * make fixup