Update rpc testing to include USE_TENSORPIPE directive (#68080)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/68080
Fixes #68002
After FaultyProcessGroupAgent was replaced with FaultyTensorpipeAgent there is now a dependency on Tensorpipe for rpc testing. However, if user does not have USE_TENSORPIPE enabled they will hit an issue such `undeclared identifier 'FaultyTensorPipeRpcBackendOptions'`. This is for testing the faulty agent method so it should not block compilation. Update to wrap the Tensorpipe specific code in a directive.
cc pietern mrshenli pritamdamania87 zhaojuanmao satgera rohan-varma gqchen aazzolini osalpekar jiayisuse SciPioneer H-Huang
Test Plan: Imported from OSS
Reviewed By: mrshenli
Differential Revision: D32292861
Pulled By: H-Huang
fbshipit-source-id: 4ffb879860ced897674728200a1831f18fea0a4a