[quant][graphmode] Support another use pattern of mean (#40038)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/40038
Test Plan: Imported from OSS
Differential Revision: D22055696
fbshipit-source-id: 776196ce3d743deb8335d237bf5ef0fa67f7f26d