Back out "[Easy][c10d] Minor fixes" (#73521)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/73521
Original commit changeset: 9ee79a72b4fc
Original Phabricator Diff: D34431929 (https://github.com/pytorch/pytorch/commit/12890abcb43acb4d77a1cb3294f23517d0c393f7)
ghstack-source-id: 150127107
Test Plan: unit tests
Reviewed By: rohan-varma
Differential Revision: D34527593
fbshipit-source-id: 050f909800626761cacc9aa0cc5af6bef20966ae
(cherry picked from commit 2ddbb49886961c0ba7f3344e3e3a41080d45bd6b)
