pytorch
3367e632 - [c10d] Make reduce as a custom op (#79686)

Commit
2 years ago
[c10d] Make reduce as a custom op (#79686) Summary: This patch makes reduce as a custom op such that it's dispatcher passable. It's one part of the effort to route comm ops to the dispatcher such that tracing mechanisms that relies on the dispatcher can trace them, e.g., LazyTensor and AOTAutograd. Test Plan: python test/distributed/test_c10d_nccl.py -k test_reduce_ops python test/distributed/test_c10d_gloo.py -k test_reduce_basics ...and other existing distributed tests. Pull Request resolved: https://github.com/pytorch/pytorch/pull/79686 Approved by: https://github.com/mrshenli
Author
Jiewen Tan
Committer
Parents
Loading