PR #30079 schedulefree optimizers

schedulefree optimizers #30079

LysandreJik merged 12 commits into huggingface:main from winglian:schedule-free-optimizer

younesbelkada commented on 2024-04-08

hiyouga commented on 2024-04-09

pacman100 commented on 2024-04-29

winglian force pushed to 9e654bbb 1 year ago

muellerzr approved these changes on 2024-05-31

muellerzr approved these changes on 2024-06-01

muellerzr requested a review from

LysandreJik 1 year ago

younesbelkada approved these changes on 2024-06-03

younesbelkada requested a review from

amyeroberts 1 year ago

amyeroberts commented on 2024-06-03

github-actions closed this 1 year ago

amyeroberts reopened this 1 year ago

winglian force pushed from 7f5516e3 1 year ago

amyeroberts commented on 2024-08-22

winglian force pushed 1 year ago

amyeroberts approved these changes on 2024-08-27

schedulefree optimizers

f515776a

fix train instead of eval for optimizer

1b95027c

fixes and update docs

40afb0d7

chore: lint

2245f575

add tests and drop overly-verbose _32bit suffix

75c68e66

chore: lint

83ca40be

fix for docs

e5f5bce1

fix code review issues

1145ede6

use duck-typing to avoid per-optimizer patches

367ac009

fixup style

2e857a88

fixup style

179232ce

winglian force pushed to 179232ce 1 year ago

muellerzr approved these changes on 2024-09-06

warn if incorrect accelerate version with schedule free

975f0459

LysandreJik approved these changes on 2024-09-09

LysandreJik merged 62aecd85 into main 1 year ago

winglian deleted the schedule-free-optimizer branch 1 year ago

Reviewers

LysandreJik

muellerzr

amyeroberts

younesbelkada

tmm1

adefazio

pacman100

hiyouga

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers schedulefree optimizers #30079 Merged

schedulefree optimizers #30079

transformers
schedulefree optimizers
#30079

Merged