Minor compile time optimizations in torch.py (#121615)
Summary:
X-link: https://github.com/pytorch/pytorch/pull/121615
Approved by: https://github.com/oulgen
Reviewed By: osalpekar
Differential Revision: D54919135
Pulled By: jansel
fbshipit-source-id: 6d6b08f4dbbaac9581c67385b551ded235d92a66
