pytorch
760967a2 - Update _store_based_barrier implementation to reduce load on rank 0 (#98000)

Commit
1 year ago
Update _store_based_barrier implementation to reduce load on rank 0 (#98000) Summary: Update from using add() which makes rank 0 overloaded with requests to a single request every 10 seconds to handle the last joined worker Added optional logging_interval arg to _store_based_barrier Test Plan: ``` pytest test/distributed/test_c10d_common.py -vsk test_store_based_barrier ``` Reviewed By: rohan-varma Differential Revision: D44430531 Pull Request resolved: https://github.com/pytorch/pytorch/pull/98000 Approved by: https://github.com/kumpera
Author
Committer
Parents
Loading