Revert D27864296: ns for fx: support binary ops when adding unshadowed loggers for inputs
Test Plan: revert-hammer
Differential Revision:
D27864296 (https://github.com/pytorch/pytorch/commit/c004346c880bb76fa911c8fdcd27b4027426c2b1)
Original commit changeset: 3cbeb728297a
fbshipit-source-id: bc87cb707b14a0965452e9a1aa0d4e37ffbe5bf1