accelerate
fix some parameter setting does not work for CPU DDP and bf16 fail in…
#527

Merged

fix some parameter setting does not work for CPU DDP and bf16 fail in… #527

sgugger merged 3 commits into huggingface:main from ddp_cpu_fix

fix some parameter setting does not work for CPU DDP and bf16 fail in…

f7f92f31

sgugger commented on 2022-07-18

if number_machine > 1, get the ip and port accelerate config set

e4fea226

sgugger commented on 2022-07-18

if main_process_ip and port is set by user, use them, else use defaul…

8270ea46

sgugger merged ddedeb40 into main 3 years ago

sywangyi deleted the ddp_cpu_fix branch 3 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone