llm-foundry
Barrier immediately after initialize dist with logs
#1140

Merged

Barrier immediately after initialize dist with logs #1140

dakinggg merged 3 commits into mosaicml:main from dakinggg:logs-barrier

Revert "Revert "First initialize dist with gloo (#1133)" (#1139)"

972799d6

just nccl

4f61becb

dakinggg commented on 2024-04-25

Update scripts/train/train.py

48ad48da

dakinggg requested a review from

irenedea 2 years ago

dakinggg requested a review from

mvpatel2000 2 years ago

mvpatel2000 approved these changes on 2024-04-25

irenedea approved these changes on 2024-04-25

dakinggg enabled auto-merge (squash) 2 years ago

dakinggg merged 6cfd2a35 into main 2 years ago

dakinggg deleted the logs-barrier branch 2 years ago

Reviewers

irenedea

mvpatel2000

Assignees

No one assigned

Labels

None yet

Milestone

No milestone