pytorch
d31707a2 - Get rid of dim_groups attribute from DeviceMesh (#103105)

Commit
1 year ago
Get rid of dim_groups attribute from DeviceMesh (#103105) This PR get rids of the dim_groups attribute from DeviceMesh, the main motivation behind this is that we should let c10d store the process groups during its creation instead of DeviceMesh, DeviceMesh should just handle ranks correctly. This could enable DTensor becomes picklable! (torch.save/load could be possible), which I will give it a try in the next PR Pull Request resolved: https://github.com/pytorch/pytorch/pull/103105 Approved by: https://github.com/XilunWu, https://github.com/fduwjj
Author
Committer
Parents
Loading