pytorch
3b1b585a - [FSDP] Fix bug in determining whether parameters need to be materialized (#97488)

Commit
1 year ago
[FSDP] Fix bug in determining whether parameters need to be materialized (#97488) Previously, `_need_to_materialize_module` would return false because: * `managed_params =_get_orig_params(module, ignored_params)` returns a generator * `is_meta_module = any(param.is_meta for param in managed_params)` exhausts the generator in its check * `any(fake.is_fake(param) for param in managed_params)` would try to iterate over the empty generator and get an empty sequence, thus returning `False` Pull Request resolved: https://github.com/pytorch/pytorch/pull/97488 Approved by: https://github.com/ngimel, https://github.com/awgu
Author
Committer
Parents
Loading