transformers

delete unnecessary code to make moe compatible to full graph compile

#43855

Merged