Revert "Re-land sym_numel (#82374) (#82726) (#82731)"
This reverts commit c90e00cf85a4ac11e6fd96963e5e95944aefc5b4.
Reverted https://github.com/pytorch/pytorch/pull/82731 on behalf of https://github.com/zengk95 due to This is breaking XLA tests on trunk. It seems to have passed on PR and was able to checkout that commit https://hud.pytorch.org/pytorch/pytorch/commit/c90e00cf85a4ac11e6fd96963e5e95944aefc5b4.
