pytorch
af841f38 - [SPMD] Allow Override.replacement to have a global view (#101427)

Commit
1 year ago
[SPMD] Allow Override.replacement to have a global view (#101427) It's easier for users to implement one Override that takes care of all target submodules of different types, instead of specifying one mapping pair for each FQN/type. For example, when calculating sharding for sparse layers, the decision needs to be make globally. In this, case it's helpful to allow user Override to get access to all submodules and make replacement decisions accordingly. Differential Revision: [D45879732](https://our.internmc.facebook.com/intern/diff/D45879732) Pull Request resolved: https://github.com/pytorch/pytorch/pull/101427 Approved by: https://github.com/fegin
Author
Committer
Parents
Loading