Allow DDP to wrap multi-GPU modules (#19271)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/19271
allow DDP to take multi-gpu models
Reviewed By: pietern
Differential Revision: D14822375
fbshipit-source-id: 1eebfaa33371766d3129f0ac6f63a573332b2f1c
