Revert D29132956: Add some TORCH_API annotations to RPC
Test Plan: revert-hammer
Differential Revision:
D29132956 (https://github.com/pytorch/pytorch/commit/04ec122868d436e32d81345343725e271d94cdfc)
Original commit changeset: 8637640d56a1
fbshipit-source-id: f497adcbfd5a6b5a46b8689b1943ae2687ea737b
