[DataLoader] Locking lower ranks seed recepients (#81071) (#81071) (#81886)
Summary:
Exit seed receiving section only when all ranks received seed, otherwise we are at risk that current rank
will reach same section of the code again while rank zero still in the previous iteration
Fixes: #80845
Pull Request resolved: https://github.com/pytorch/pytorch/pull/81071
Approved by: https://github.com/msaroufim, https://github.com/ejguan
Test Plan:
contbuild & OSS CI, see https://hud.pytorch.org/commit/pytorch/pytorch/e9b3bc2eadb8ffe10c002abcd5a34a5b7d36f390
Original Phabricator Test Plan:
Imported from OSS
Reviewed By: mehtanirav, ejguan
Differential Revision: D37702557
Pulled By: VitalyFedyunin
fbshipit-source-id: 51dd950e1bfc2c984a4ddbe6481e225023b0a202
Co-authored-by: Vitaly Fedyunin (Meta Employee) <vitalyf@fb.com>
