pytorch
4c584acc - [FSDP]Add device_mesh to FSDPstate (#102317)

Commit
1 year ago
[FSDP]Add device_mesh to FSDPstate (#102317) This PR creates a device_mesh and share it across all FSDP state. The device_mesh will later be used to test out dtensor state_dict (1d device_mesh). Pull Request resolved: https://github.com/pytorch/pytorch/pull/102317 Approved by: https://github.com/awgu
Author
Committer
Parents
Loading