pytorch
a920ac5f - Update base for Update on "[DDP] Support for multiple backwards"

Commit
3 years ago
Update base for Update on "[DDP] Support for multiple backwards" Move `prepare_for_backward` into `_DDPSink` backward instead of calling it in DDP forward pass so that we can run multiple backwards in DDP with `retain_graph=True`. Differential Revision: [D28855226](https://our.internmc.facebook.com/intern/diff/D28855226/) [ghstack-poisoned]
Author
Loading