pytorch
83b803c2 - [FSDP] Fix `use_orig_params=True`, CPU offload, `no_sync()` (#100180)

Commit
1 year ago
[FSDP] Fix `use_orig_params=True`, CPU offload, `no_sync()` (#100180) This should fix https://github.com/pytorch/pytorch/issues/98494. We follow a similar approach as in past PRs for mismatched dtype or size from running in `no_sync()`. Pull Request resolved: https://github.com/pytorch/pytorch/pull/100180 Approved by: https://github.com/rohan-varma
Author
Committer
Parents
Loading