[PTD] Introduce tracing friendly collectives. (#93990)
This change adds torch.distributed.traceable_collectives.
This experimental API enables collectives to be fully traced by dynamo and FX.
See #93173 for the RFC
Pull Request resolved: https://github.com/pytorch/pytorch/pull/93990
Approved by: https://github.com/wconstab, https://github.com/wanchaol, https://github.com/H-Huang
