[quant][graphmode][refactor] Move the whitelists to a centeralized place (#35721)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/35721
Test Plan:
.
Imported from OSS
Differential Revision: D20771829
fbshipit-source-id: f6ec3afe2d8034acbdbd81e5a6fbd4a2a76aa7ac
