Revert "Change SymIntNode into an intrusive pointer (#82432)"
This reverts commit 7be44f8158a817c64de7e2732eba42fc060209f4.
Reverted https://github.com/pytorch/pytorch/pull/82432 on behalf of https://github.com/ezyang due to segfaults on test but not caught in CI
