Don't construct a single element array for unary ops
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/22469
Test Plan: Imported from OSS
Differential Revision: D16105794
Pulled By: jamesr66a
fbshipit-source-id: 6bb5a6703c8dba3cda20a6db192d2a15711751a1
