PR #34452 Remove FSDP wrapping from sub-models.

Remove FSDP wrapping from sub-models. #34452

ArthurZucker merged 6 commits into huggingface:main from eljandoubi:fix_fsdp_auto_wrap_policy

SunMarc commented on 2024-10-28

muellerzr approved these changes on 2024-10-30

muellerzr requested a review from

ArthurZucker 1 year ago

muellerzr requested a review from

LysandreJik 1 year ago

SunMarc approved these changes on 2024-11-04

LysandreJik approved these changes on 2024-11-05

ArthurZucker removed review request from

ArthurZucker 1 year ago

Remove FSDP wrapping from sub-models.

ab9934e1

solve conflict trainer.py

d518f764

make fixup

e76dfd03

add unit test for fsdp_auto_wrap_policy when using auto_find_batch_size

a6dcb92a

put back extract_model_from_parallel

7ebb2c61

use transformers unwrap_model

0df20d68

eljandoubi force pushed to 0df20d68 1 year ago

ArthurZucker merged 8d50fda6 into main 1 year ago

Reviewers

LysandreJik

SunMarc

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone