pytorch
9ac56ef0 - [DDP] log gradient ready order and bucket indices (#62751)

Commit
3 years ago
[DDP] log gradient ready order and bucket indices (#62751) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/62751 This will help us determine whether gradient ready order and bucket indices are aligned amongst all the ranks. This should always be true for rank 0 as we determine rebuilt bucket order by the gradient ready order on rank 0, but would be interested to see this on different workloads for other ranks ghstack-source-id: 135104369 Test Plan: CI Reviewed By: SciPioneer, wanchaol Differential Revision: D30111833 fbshipit-source-id: a0ab38413a45022d953da76384800bee53cbcf9f
Author
Parents
Loading