Add DistributedDataParallel Benchmark for Single-GPU, Multi-GPU, and Multi-Machine (#850)
Summary: Pull Request resolved: https://github.com/pytorch/benchmark/pull/850
Reviewed By: xuzhao9
Differential Revision: D35993427
Pulled By: mrshenli
fbshipit-source-id: a9b08e78421c6745e014ebe91240dc23aad47b35