PR #34642 Fix hyperparameter search when optuna+deepseed

Fix hyperparameter search when optuna+deepseed #34642

SunMarc merged 2 commits into huggingface:main from corentin-ryr:fix-hp-search-ddp

corentin-ryr force pushed 1 year ago

LysandreJik requested a review from

SunMarc 1 year ago

LysandreJik removed review request from

SunMarc 1 year ago

LysandreJik requested a review from

muellerzr 1 year ago

LysandreJik requested a review from

SunMarc 1 year ago

SunMarc approved these changes on 2024-11-15

Fix hyperparameter search when optuna+deepseed

f8962447

Adding free_memory to the search setup

5704d088

corentin-ryr force pushed to 5704d088 1 year ago

sywangyi approved these changes on 2024-11-18

SunMarc requested a review from

LysandreJik 1 year ago

LysandreJik approved these changes on 2024-11-19

muellerzr approved these changes on 2024-11-20

SunMarc merged bf42c3bd into main 1 year ago

corentin-ryr deleted the fix-hp-search-ddp branch 1 year ago

Reviewers

LysandreJik

SunMarc

muellerzr

sywangyi

Assignees

No one assigned

Labels

None yet

Milestone

No milestone