PR #17570 enable cpu distribution training using mpirun

enable cpu distribution training using mpirun #17570

sgugger merged 3 commits into huggingface:main from sywangyi:distribute_train_cpu

enable cpu distribution training using mpirun

75e3dfce

sgugger commented on 2022-06-07

fix according to the review comment

a4262400

sgugger commented on 2022-06-08

use accelerate logic for cpu distribution training to set "RANK","LOC…

cd9d325d

sgugger approved these changes on 2022-06-13

sgugger merged 4aabf9b5 into main 4 years ago

sywangyi deleted the distribute_train_cpu branch 3 years ago

Reviewers

sgugger

yao-matrix

Assignees

No one assigned

Labels

None yet

Milestone

No milestone