pytorch
270c27ef - [FSDP] Add always_wrap policy (#73687)

Commit
2 years ago
[FSDP] Add always_wrap policy (#73687) Summary: Add a smaller helper policy that always returns True to automatically always wrap all FSDP submodules. This is the first and simplest step of providing a set of policies that allow users to seamlessly experiment with different FSDP config. More Context: https://github.com/pytorch/pytorch/issues/68789 Pull Request resolved: https://github.com/pytorch/pytorch/pull/73687 Reviewed By: jbschlosser, zhaojuanmao Differential Revision: D34625801 Pulled By: rohan-varma fbshipit-source-id: f20c951f8d62ea29b504543c93acd546247d8206 (cherry picked from commit 3b0bf02bc8bb236ee09e2fa986d52bbf5231efc3)
Author
Committer
Parents
Loading