transformers
Add FSDP config for CPU RAM efficient loading through accelerate
#30002

Merged

Add FSDP config for CPU RAM efficient loading through accelerate #30002

amyeroberts merged 7 commits into huggingface:main from helloworld1:helloworld1/cpu_ram_efficient_loading

helloworld1 force pushed 2 years ago

ArthurZucker requested a review from

muellerzr 2 years ago

muellerzr approved these changes on 2024-04-18

muellerzr requested a review from

amyeroberts 2 years ago

amyeroberts commented on 2024-04-18

pacman100 approved these changes on 2024-04-18

Add FSDP config for CPU RAM efficient loading

2e2452ad

Style fix

b2f10c1a

Update src/transformers/training_args.py

3dddc8c5

Update src/transformers/training_args.py

48b2fc48

Add sync_module_states and cpu_ram_efficient_loading validation logic

e81cd989

helloworld1 force pushed to e81cd989 2 years ago

amyeroberts approved these changes on 2024-04-19

Update src/transformers/training_args.py

579a0363

Style

a2978fb9

helloworld1 force pushed to a2978fb9 2 years ago

amyeroberts merged f16caf44 into main 2 years ago

Reviewers

amyeroberts

pacman100

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone