Revert "CUDA Graph Trees - error on deallocated access (#100927)"
This reverts commit 3941bbc5ba10acdf103cd91bab7de67bfef95957.
Reverted https://github.com/pytorch/pytorch/pull/100927 on behalf of https://github.com/jeanschmidt due to breaking internal builds ([comment](https://github.com/pytorch/pytorch/pull/100927#issuecomment-1543874258))
