pytorch
c1e28731 - [FSDP()][10/N][11/N] Introduce composable (ctor only) (#87924)

Commit
2 years ago
[FSDP()][10/N][11/N] Introduce composable (ctor only) (#87924) This PR introduces the composable FSDP API (with constructor semantics only) along with some further constructor refactoring. A notable contribution here is `_get_submodule_to_states()`, which performs auto wrapping without actually wrapping. Pull Request resolved: https://github.com/pytorch/pytorch/pull/87924 Approved by: https://github.com/mrshenli
Author
Committer
Parents
Loading