[quant][graphmode] Refactor quantization patterns (#40894)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/40894
Test Plan:
python test/test_quantization.py
Imported from OSS
Differential Revision: D22403901
fbshipit-source-id: e0bcf8a628c6a1acfe6fa10a52912360a619bc62
