Specify requires_grad for Parameter replica so it's not always set to True by default (#32356)
Summary:
This is the proposed fix for issue https://github.com/pytorch/pytorch/issues/32018
Pull Request resolved: https://github.com/pytorch/pytorch/pull/32356
Differential Revision: D19450648
Pulled By: mrshenli
fbshipit-source-id: c63eeb6e9f5a87ebe613dd7013907559f295a7ea
