Use RPC context streams to cover serde ops (#57926)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/57926
Test Plan: Imported from OSS
Reviewed By: lw
Differential Revision: D28316526
Pulled By: mrshenli
fbshipit-source-id: 1907ec8f46e40fa5049d810c6ad959263361b6aa