PR #24980 fsdp fixes and enhancements

fsdp fixes and enhancements #24980

pacman100 merged 4 commits into main from smangrul/fsdp-prep-fix

fix fsdp prepare to remove the warnings and fix excess memory usage

b783dfb3

Update training_args.py

241f184c

pacman100 changed the title ~~fix fsdp prepare to remove the warnings and fix excess memory usage~~ fsdp fixes and enhancements 2 years ago

pacman100 marked this pull request as ready for review 2 years ago

pacman100 requested a review from

sgugger 2 years ago

parity for FSDP+XLA

6a9d8e23

Update trainer.py

c3a225f1

sgugger approved these changes on 2023-07-21

pacman100 merged f4eb459e into main 2 years ago

pacman100 deleted the smangrul/fsdp-prep-fix branch 2 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone