Remove unnecessary checks in InsertQuantDeQuantImpl (#25370)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/25370
Removes some checking code that is copied from insert_observers pass
Test Plan:
python test/test_jit.py 'TestJit.test_insert_quant_dequant'
Imported from OSS
Differential Revision: D17106633
fbshipit-source-id: 3c39be89dbf58dc6ffd63e1ee1283eba65243ea6
