pytorch
238eaf20 - [c10d] Make barrier as a custom op (#79777)

Commit
2 years ago
[c10d] Make barrier as a custom op (#79777) Summary: This patch makes barrier as a custom op such that it's dispatcher passable. It's one part of the effort to route comm ops to the dispatcher such that tracing mechanisms that relies on the dispatcher can trace them, e.g., LazyTensor and AOTAutograd. Test Plan: python test/distributed/test_c10d_nccl.py -k test_nccl_barrier ...and other existing distributed tests. Pull Request resolved: https://github.com/pytorch/pytorch/pull/79777 Approved by: https://github.com/mrshenli, https://github.com/wanchaol
Author
Jiewen Tan
Committer
Parents
Loading