Fake quantization enhancements for QAT/PTQ support- fix tests (#26876)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/26876
Add ability to turn fake quantization and observers independently.
ghstack-source-id: 90892132
Test Plan: buck test caffe2/test:quantized -- 'test_conv_bn_relu \(test_qat\.IntrinsicQATModuleTest\)' --print-passing-details
Differential Revision: D17592961
fbshipit-source-id: 24c60c94ed7c6c9fa55c634a8545731614e4f52f
