pytorch
9d6e3f81 - [c10d] Make gather as a custom op (#79687)

Commit
2 years ago
[c10d] Make gather as a custom op (#79687) Summary: This patch makes gather as a custom op such that it's dispatcher passable. It's one part of the effort to route comm ops to the dispatcher such that tracing mechanisms that relies on the dispatcher can trace them, e.g., LazyTensor and AOTAutograd. Test Plan: python test/distributed/test_c10d_nccl.py -k test_gather_ops python test/distributed/test_c10d_gloo.py -k test_gather_basics ...and other existing distributed tests. Pull Request resolved: https://github.com/pytorch/pytorch/pull/79687 Approved by: https://github.com/mrshenli
Author
Jiewen Tan
Committer
Parents
Loading