PR #3983 Multiply lr scheduler steps by `num_processes`.

Multiply lr scheduler steps by `num_processes`. #3983

sayakpaul merged 2 commits into huggingface:main from eliphatfs:main

Multiply lr scheduler steps by `num_processes`.

b32bcb8e

sayakpaul approved these changes on 2023-07-07

Stop multiplying steps by gradient accumulation.

660c5519

sayakpaul requested a review from

muellerzr 2 years ago

muellerzr approved these changes on 2023-07-13

sayakpaul merged ece55227 into main 2 years ago

Reviewers

sayakpaul

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone