Revert D31732417: Fix bug preventing optimization from firing
Test Plan: revert-hammer
Differential Revision:
D31732417 (https://github.com/pytorch/pytorch/commit/853fc25fb0471ba8dbdffac99b8d5a5be8e40594)
Original commit changeset: dd734254c021
fbshipit-source-id: 3da0663dac5b5d2117b3d7abdbcd45d96f98de33
