PR #5484 Fix FSDP for Models with Frozen Weights

Fix FSDP for Models with Frozen Weights #5484

alanwaketan merged 5 commits into master from liyanglu/fsdp_fix

Fix fsdp not freeing forzen full params

c8453b21

Merge branch 'master' into liyanglu/fsdp_fix

3b713199

Liyang90 requested a review from

ronghanghu 2 years ago

Liyang90 requested a review from

alanwaketan 2 years ago

Liyang90 marked this pull request as draft 2 years ago

add test

b32ec87c

formatting

5dc7e905

Liyang90 marked this pull request as ready for review 2 years ago

alanwaketan commented on 2023-08-30

remove unnecessary env var in test

d92e36f5

Liyang90 changed the title ~~Liyanglu/fsdp fix~~ Fix FSDP for Models with Frozen Weights 2 years ago

alanwaketan approved these changes on 2023-08-30

alanwaketan merged 3bdb4b10 into master 2 years ago

Reviewers

alanwaketan

ronghanghu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone