pytorch
0f5b6caa - [FSDP][optim_state_dict] Ignore the state check on rank that does not own the corresponding parameter (#93318)

Commit
1 year ago
[FSDP][optim_state_dict] Ignore the state check on rank that does not own the corresponding parameter (#93318) When a rank does not own a parameter (parameter.numel() == 0), its optim state is not valid and should not be checked against the current saved one. Differential Revision: [D42865237](https://our.internmc.facebook.com/intern/diff/D42865237/) Pull Request resolved: https://github.com/pytorch/pytorch/pull/93318 Approved by: https://github.com/rohan-varma
Author
Committer
Parents
Loading