pytorch

f4a044ca - [distributed] add options field in ProcessGroupGloo/NCCL (#54090)

[distributed] add options field in ProcessGroupGloo/NCCL (#54090) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/54090 This PR adds an options field to both ProcessGroupGloo/NCCL so that we have a constant `options` field even after the initialization of ProcessGroup, which gives us the ability to inspect the options during construction of specific ProcessGroup. Also use options inside different methods instead of separate fields. Test Plan: Imported from OSS Reviewed By: rohan-varma Differential Revision: D27093670 Pulled By: wanchaol fbshipit-source-id: b02d9394290e9be88b21bddb94d4de7993b4a2e3