pytorch
bc9e8af2 - [distributed.nn] Change remote module template instantiator to write to tmp folder (#40173)

Commit
4 years ago
[distributed.nn] Change remote module template instantiator to write to tmp folder (#40173) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/40173 - Avoid path sharing across runs and workers, so even the test methods/workers run in parallel on the same host, they don't interfere with each other. - On some environment (e.g. fb internal CI platform), the torch package file tree is not writable. But the temporary folder chosen by Python `tempfile` module is always writable, on linux it's "/tmp". close https://github.com/pytorch/pytorch/issues/40120 ghstack-source-id: 106086340 Test Plan: ``` buck test mode/dev-nosan //caffe2/test/distributed/nn/jit:test_instantiator buck build mode/dev-nosan //caffe2/test/distributed/nn/jit:test_instantiator && \ buck-out/gen/caffe2/test/distributed/nn/jit/test_instantiator\#binary.par -r test_instantiate_scripted_remote_module_template buck build mode/dev-nosan //caffe2/test/distributed/nn/jit:test_instantiator && \ buck-out/gen/caffe2/test/distributed/nn/jit/test_instantiator\#binary.par -r test_instantiate_non_scripted_remote_module_template ``` ``` buck test mode/dev-nosan //caffe2/test/distributed/nn/api:remote_module_fork ``` Differential Revision: D5708493 fbshipit-source-id: dd92695682433aaf79d1912c7956cef40a450eaf
Author
Parents
Loading