Some simple optimizations (#51831)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51831
Reviewed By: albanD
Differential Revision: D26379122
Pulled By: VitalyFedyunin
fbshipit-source-id: d3562232f8501f2ad0b291586bf7f828e9b47010
