transformers
Llama et al. / FSDP : Fix breaking change in 4.40 for FSDP
#31161

Merged

Llama et al. / FSDP : Fix breaking change in 4.40 for FSDP #31161

amyeroberts merged 14 commits into main from fix-llama-fsdp

fix llama fsdp

a2ba7053

younesbelkada requested a review from

amyeroberts 2 years ago

fixup

51881061

younesbelkada requested a review from

LysandreJik 2 years ago

amyeroberts commented on 2024-06-03

Merge remote-tracking branch 'origin/main' into HEAD

51e05137

adding FSDP tests for CPU offloading

91c7b0d3

fixes

d04ae5bb

fix tests

ac7977cd

fix tests

8e65359e

add it for mixtral

705afe43

propagate the changes on other models

3ce51785

younesbelkada requested a review from

amyeroberts 2 years ago

Merge branch 'main' into fix-llama-fsdp

bb4c47a4

amyeroberts commented on 2024-06-26

Update src/transformers/models/phi/modeling_phi.py

bd3fe928

Delete utils/testing_scripts/fsdp_cpu_offloading.py

35981b67

Delete utils/testing_scripts/dummy_fsdp_config.yml

b5e31457

amyeroberts commented on 2024-06-26

Update + add cache_positions docstring

4c9831ef

amyeroberts approved these changes on 2024-06-26

amyeroberts merged 3f93fd06 into main 1 year ago

amyeroberts deleted the fix-llama-fsdp branch 1 year ago

Reviewers

amyeroberts

LysandreJik

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Llama et al. / FSDP : Fix breaking change in 4.40 for FSDP #31161 Merged

Llama et al. / FSDP : Fix breaking change in 4.40 for FSDP #31161

transformers
Llama et al. / FSDP : Fix breaking change in 4.40 for FSDP
#31161

Merged