[c10d] Make scatter as a custom op (#79688)
Summary:
This patch makes scatter as a custom op such that it's dispatcher
passable. It's one part of the effort to route comm ops to the dispatcher
such that tracing mechanisms that relies on the dispatcher can trace them,
e.g., LazyTensor and AOTAutograd.
Test Plan:
python test/distributed/test_c10d_nccl.py -k test_scatter_ops
python test/distributed/test_c10d_gloo.py -k test_scatter_basics
...and other existing distributed tests.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/79688
Approved by: https://github.com/mrshenli
