Remove unnecessary py::object copy in PyRRef ctor (#38402)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/38402
Test Plan: Imported from OSS
Differential Revision: D21554724
Pulled By: mrshenli
fbshipit-source-id: abab45010810ec53628ea2c7a9c76cdc50eb2f74
