[Shape Inference] Try to infer input of elementwise ops (#35701)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/35701
Reviewed By: yinghai
Differential Revision: D20745111
fbshipit-source-id: 5fcfe3796c1e80d4cf8843713089d802f3bf3759