Run sparse tests only for TensorPipe agent. (#66600)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/66600
Sparse RPC functionality added in
https://github.com/pytorch/pytorch/pull/62794 works only for TensorPipe and is
broken for other agent types.
Moving these tests to a TensorPipe only class.
ghstack-source-id: 140553147
Test Plan: waitforbuildbot
Reviewed By: rohan-varma
Differential Revision: D31633305
fbshipit-source-id: 37d94cb9ed5565a72a6d512c2a9db75a497d5b95
