Splitter: Transformer_encoder (#66952)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/66952
Added splitter to lower parts of the transformer model
Program now supports arg input
Test Plan:
Performance on non-lowered model:
0.19662559509277344
Performance on semi-lowered model:
0.19131642150878905
Reviewed By: 842974287
Differential Revision: D31541325
fbshipit-source-id: 194aba97afc794dbeada4bbc4777d0a7b02e3635
