transformers
[`Falcon`] Remove SDPA for falcon to support earlier versions of PyTorch (< 2.0)
#25947

Merged

[`Falcon`] Remove SDPA for falcon to support earlier versions of PyTorch (< 2.0) #25947

LysandreJik merged 5 commits into huggingface:main from younesbelkada:rm-sdpa-falcon

remove SDPA for falcon

a21c0940

younesbelkada requested a review from

amyeroberts 2 years ago

younesbelkada requested a review from

Rocketknight1 2 years ago

amyeroberts approved these changes on 2023-09-04

Rocketknight1 approved these changes on 2023-09-04

revert previous behaviour and add warning

392cb6c5

younesbelkada requested a review from

Rocketknight1 2 years ago

younesbelkada requested a review from

amyeroberts 2 years ago

younesbelkada requested a review from

patrickvonplaten 2 years ago

nit

ec3c0c70

Rocketknight1 approved these changes on 2023-09-04

Update src/transformers/models/falcon/modeling_falcon.py

4899ce8c

LysandreJik commented on 2023-09-04

LysandreJik approved these changes on 2023-09-04

Update src/transformers/models/falcon/modeling_falcon.py

5069cdfd

LysandreJik merged 49b69fe0 into main 2 years ago

younesbelkada deleted the rm-sdpa-falcon branch 2 years ago

Reviewers

LysandreJik

Rocketknight1

amyeroberts

patrickvonplaten

Assignees

No one assigned

Labels

None yet

Milestone

No milestone