Simplify replicate logic (#36174)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/36174
Test Plan: Imported from OSS
Differential Revision: D20903301
Pulled By: zdevito
fbshipit-source-id: 714a32fe417b7d1615886936c41505d1ba538f47
