Revert D28497967: [quant][fx][graphmode][refactor] Remove qconfig_map from Quantizer
Test Plan: revert-hammer
Differential Revision:
D28497967 (https://github.com/pytorch/pytorch/commit/1cf8f7a43944ee39e977769d26bc2d5f40abcd40)
Original commit changeset: 421ce3d86fad
fbshipit-source-id: b1b290be47d847ab0e0128e3ae89f528578550ee
