[quant][fx] Cleanup unused to_fp16 check code in lowering (#74969)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/74969
We can remove the check for fp16 ops now since we confirmed that fp16 ops are not
used
Test Plan:
python test/test_quantization.py TestQuantizeFx
python test/test_quantization.py TestQuantizeFxOps
Imported from OSS
Reviewed By: andrewor14
Differential Revision: D35258695
fbshipit-source-id: 2297696493feb62a4c959e7fbdd6123f59615ef1
(cherry picked from commit a1b4658e661ce610e264e083dfa738c31859ec1a)
