accelerate
Fix scheduler incorrect steps when gradient accumulation enabled
#999

Merged

Fix scheduler incorrect steps when gradient accumulation enabled #999

sgugger merged 2 commits into huggingface:main from markovalexander:fix-scheduler-incorrect-steps-when-gradient-accumulation-enabled

add additional check for optimizer step

99b65638

rewrite scheduler w/ grad accumulation test

0c34daaa

sgugger commented on 2023-01-23

sgugger approved these changes on 2023-01-23

muellerzr approved these changes on 2023-01-23

sgugger merged 55a52848 into main 3 years ago

Reviewers

sgugger

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone