Revert "Add context manager to save tensors on CPU (#61928)"
This reverts commit 9beb279d848e9b141027a0f3e395b8329bf1733e.
ghstack-source-id: f4ad32c72c88e0e6b618f0535de52dec684f3871
Pull Request resolved: https://github.com/pytorch/pytorch/pull/62693
