[reland] Move RPC agents to libtorch (#60170)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/60170
Reland of #59939.
Test Plan: CI
Reviewed By: mrshenli
Differential Revision: D29193234
fbshipit-source-id: ee2a90d6be961c10f91361512bdd4cadca43dd60
