Caffe2 shouldn't fail if CUDA peer access is already enabled
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/19586
Differential Revision: D15061544
Pulled By: dzhulgakov
fbshipit-source-id: 6a5f9f4fe45259d689671f58ad5206cdaf15c5bd
