Port ATen/native to ATen/Parallel (#20043)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/20043
ghimport-source-id: 8003ef8ca335d4c4717a886a3a75fd78ec53ade5
Differential Revision: D15248505
Pulled By: ilia-cher
fbshipit-source-id: 7be500ed8bfb23cc36f1dd7108e344319e3e5332
