Revert D23335106: [quant][graphmode][fix] Fix insert quant dequant for observers without qparams
Test Plan: revert-hammer
Differential Revision:
D23335106 (https://github.com/pytorch/pytorch/commit/602209751e825b478f2718b38be0ffe7a768e20b)
Original commit changeset: 84af2884d521
fbshipit-source-id: 8d227fe2048b532016407d8ecfbaa6ffd1c313fd
