Back out "[Quant][Eager] Added 4 bit support for eager mode quantization flow" (#70272)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/70272
Original commit changeset: 5cdaac5aee9b
Original Phabricator Diff: D33152675 (https://github.com/pytorch/pytorch/commit/75718e5059b30cb95f9c2ba2d9a68a7fafc43624)
Test Plan: CI
Reviewed By: larryliu0820
Differential Revision: D33268415
fbshipit-source-id: 99eb3209d513149ed23a1d9071d1b1c12174d09a