pytorch
78170701 - [FSDP()][9/N] Refactor ctor (continued) (#87923)

Commit
2 years ago
[FSDP()][9/N] Refactor ctor (continued) (#87923) This PR makes a second pass over the constructor. The logic has been grouped into `_init_<...>` functions based on intent (e.g. `_init_prefetching_state()` or `_init_runtime_state()`). This makes the initialization code for composable FSDP much cleaner than having to re-write the same sequences of lower-level helper calls. This PR also moves `_ExecOrderData` into its own file `_exec_order_utils.py`. Pull Request resolved: https://github.com/pytorch/pytorch/pull/87923 Approved by: https://github.com/mrshenli
Author
Committer
Parents
Loading