[quant][test] Remove numeric equivalence test for debug and non-debug option (#45852)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/45852
Test Plan: Imported from OSS
Reviewed By: vkuzo
Differential Revision: D24115329
fbshipit-source-id: ad32e68cbd54431fd440c8437a4361905a5dbdad
