[quant] Adding zero point type check for per channel quantization (#40811)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/40811
Test Plan: Imported from OSS
Differential Revision: D22319417
Pulled By: z-a-f
fbshipit-source-id: 7be3a511ddd33b5fe749a83166bbc5874d1bd539
