transformers
Support saving only PEFT adapter in checkpoints when using PEFT + FSDP
#28297

Merged

Support saving only PEFT adapter in checkpoints when using PEFT + FSDP #28297

amyeroberts merged 6 commits into huggingface:main from AjayP13:AjayP13-patch-1

younesbelkada approved these changes on 2024-01-08

pacman100 commented on 2024-01-09

younesbelkada commented on 2024-01-10

pacman100 commented on 2024-01-18

pacman100 approved these changes on 2024-01-19

amyeroberts approved these changes on 2024-01-22

younesbelkada approved these changes on 2024-01-22

AjayP13 force pushed 1 year ago

Update trainer.py

24bd72cb

Revert "Update trainer.py"

fe23fa4b

Make trainer.py use adapter_only=True when using FSDP + PEFT

290d6287

Support load_best_model with adapter_only=True

2c3ad747

Ruff format

60323d31

Inspect function args for save_ load_ fsdp utility functions and only…

6c052b44

AjayP13 force pushed to 6c052b44 1 year ago

amyeroberts merged a055d09e into main 1 year ago

Reviewers

younesbelkada

amyeroberts

pacman100

Assignees

No one assigned

Labels

None yet

Milestone

No milestone