PR #1753 FSDP enhancements and fixes

FSDP enhancements and fixes #1753

pacman100 merged 4 commits into huggingface:main from pacman100:smangrul/fsdp-prep-fix

if the model is already an FSDP instance, remove the warning and prep…

d07a4323

pacman100 changed the title ~~if the model is already an FSDP instance, remove the warning and prep overhead~~ if the model is already an FSDP instance, remove the warning and prepare overhead 2 years ago

pacman100 changed the title ~~if the model is already an FSDP instance, remove the warning and prepare overhead~~ If the model is already an instance of FSDP, bypass the warning and additional FSDP preparation logic 2 years ago

allow usage of `_no_split_modules` to simplify UX when using FSDP

83fc6090

pacman100 changed the title ~~If the model is already an instance of FSDP, bypass the warning and additional FSDP preparation logic~~ FSDP enhancements and fixes 2 years ago

pacman100 marked this pull request as ready for review 2 years ago

pacman100 requested a review from

sgugger 2 years ago

Update other.py

1ba95891

fixes

334d2c81

sgugger approved these changes on 2023-07-21

pacman100 merged a2d8f540 into main 2 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

accelerate FSDP enhancements and fixes #1753 Merged

FSDP enhancements and fixes #1753

accelerate
FSDP enhancements and fixes
#1753

Merged