[rpc] special case tensor type check when getting RRef (#33582)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/33582
Test Plan: Imported from OSS
Differential Revision: D20009837
Pulled By: wanchaol
fbshipit-source-id: 7e9ab87d4dddb822c7575891a2b620eff83bfa00
