PR #34452 Remove FSDP wrapping from sub-models.

Remove FSDP wrapping from sub-models.

eljandoubi committed 1 year ago

solve conflict trainer.py

eljandoubi committed 1 year ago

make fixup

eljandoubi committed 1 year ago

add unit test for fsdp_auto_wrap_policy when using auto_find_batch_size

eljandoubi committed 1 year ago

put back extract_model_from_parallel

eljandoubi committed 1 year ago

use transformers unwrap_model

eljandoubi committed 1 year ago

transformers Remove FSDP wrapping from sub-models. #34452 Merged