pytorch

c02e2ff0 - Support multi-device configuration for MKL-DNN (#12856)

Support multi-device configuration for MKL-DNN (#12856) Summary: MKL-DNN support multi-node mode，but not support multi-devices mode,this commit will support multi-devices for MKL-DNN.This commit depend on https://github.com/pytorch/pytorch/pull/11330 Pull Request resolved: https://github.com/pytorch/pytorch/pull/12856 Differential Revision: D13735075 Pulled By: ezyang fbshipit-source-id: b63f92b7c792051f5cb22e3dda948013676e109b