Revert D23002043: add net transforms for fusion
Test Plan: revert-hammer
Differential Revision:
D23002043 (https://github.com/pytorch/pytorch/commit/a4b763bc2c24381bd9ad98fb70f0dc721b101c31)
Original commit changeset: f0b13d51d68c
fbshipit-source-id: d43602743af35db825e951358992e979283a26f6
