pytorch
4fd98dfe - Don't only apply DDP optimizer on forward frames (#87097)

Commit
3 years ago
Don't only apply DDP optimizer on forward frames (#87097) Previously a check would only apply DDP optimizer on frames named "forward". But on hf_T5_large, a graph break causes some frames like: ``` <graph break in _shift_right> <graph break in forward> ``` So instead, apply DDP optimizer on all frames. Pull Request resolved: https://github.com/pytorch/pytorch/pull/87097 Approved by: https://github.com/wconstab
Author
Committer
Parents
Loading