Skip RPC's CPU-only tests on CircleCI GPU jobs (#55778)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/55778
The RPC suite takes very long to run, and most of it is CPU-only. As long as we run the CPU-only part on some CPU worker on CircleCI, we can skip it on the GPU workers (which are expensive and we should waste their time).
ghstack-source-id: 126270873
Test Plan: Exported to CircleCI and checked that the CPU-only part still runs on the CPU workers but doesn't on the GPU workers.
Reviewed By: mrshenli
Differential Revision: D27705941
fbshipit-source-id: a0a509d6e72cf69e417f4b48336df534b070a66d
