PR #18134 FSDP integration enhancements and fixes

FSDP integration enhancements and fixes #18134

pacman100 merged 3 commits into main from smangrul/fsdp-integration-enhancements-and-fixes

FSDP integration enhancements and fixes

806e5bf1

pacman100 requested a review from

sgugger 3 years ago

pacman100 marked this pull request as ready for review 3 years ago

sgugger approved these changes on 2022-07-14

resolving comments

6990fd0e

fsdp fp16 mixed precision requires `ShardedGradScaler`

7391d5ae

sgugger approved these changes on 2022-07-18

pacman100 merged bc8e30ba into main 3 years ago

pacman100 deleted the smangrul/fsdp-integration-enhancements-and-fixes branch 3 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone