Remove redundant `torch.cuda.set_device(self.rank)` (#62097)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/62097
as title
ghstack-source-id: 134196740
Test Plan: buck test mode/dev-nosan caffe2/test/distributed:distributed_nccl_fork -- test_ddp_profiling_autograd_profiler
Reviewed By: rohan-varma
Differential Revision: D29880040
fbshipit-source-id: 6a06fb2d87e9a7dfa1d7c81bf0c3fe115c1a1abb
