Fix step shifting when accumulate gradient #33673
muellerzr
merged
12 commits into
huggingface:main
from
kibitzing:fix-step-shifting-when-accum-grad
replace total_batched_samples with step while counting grad accum step
6720364a
remove unused variable
59273e69
SunMarc
commented
on 2024-09-26
simplify condition for update step
81215c0c
fix format by ruff
e4cc3609
simplify update step condition using accelerator.sync_gradients
8348ff4e
muellerzr
approved these changes
on 2024-10-24
SunMarc
commented
on 2024-10-24
kibitzing
commented
on 2024-10-25
Merge branch 'main' into fix-step-shifting-when-accum-grad
ffd4c83e
simplify update condition using do_sync_step
ca715e78
Merge branch 'main' into fix-step-shifting-when-accum-grad
53c2ed84
remove print for test
8f210263
SunMarc
approved these changes
on 2024-10-25
Merge branch 'main' into fix-step-shifting-when-accum-grad
a69efb02
Merge branch 'main' into fix-step-shifting-when-accum-grad
0333ba08
Merge branch 'main' into fix-step-shifting-when-accum-grad
041971e7
LysandreJik
approved these changes
on 2024-10-31
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub