pytorch
df44f015 - [Gradient Compression] Do not skip the comm hook tests for Gloo/MPI backends (#58444)

Commit
3 years ago
[Gradient Compression] Do not skip the comm hook tests for Gloo/MPI backends (#58444) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/58444 DDP communication hooks are already supported on Gloo and MPI backends. No longer need to skip these tests on Gloo/MPI backends. TODO: `test_ddp_hook_parity_powerSGD` failes on Gloo backend. Filed a bug #58467. ghstack-source-id: 129209528 Test Plan: buck test mode/dev-nosan caffe2/test/distributed:distributed_gloo_fork -- test_ddp_comm_hook_logging buck test mode/dev-nosan caffe2/test/distributed:distributed_gloo_fork -- test_ddp_hook_parity_allreduce buck test mode/dev-nosan caffe2/test/distributed:distributed_gloo_fork -- test_ddp_hook_parity_allreduce_process_group buck test mode/dev-nosan caffe2/test/distributed:distributed_gloo_fork -- test_ddp_hook_parity_powerSGD Reviewed By: rohan-varma Differential Revision: D28494073 fbshipit-source-id: 6ba14082f98696bc4bd8c02395cb58b9c1795015
Author
Yi Wang
Parents
Loading