PR #26489 [`FA2`] Add flash attention for for `DistilBert`

[`FA2`] Add flash attention for for `DistilBert` #26489

amyeroberts merged 7 commits into huggingface:main from susnato:flash_attn_DistilBert

flash attention added for DistilBert

de6d3a92

susnato commented on 2023-09-29

Merge branch 'main' into flash_attn_DistilBert

a0959d88

fixes

aa4c332f

removed padding_masks

43c25786

susnato changed the title ~~Add flash attention for for `DistilBert`~~ [`FA2`] Add flash attention for for `DistilBert` 2 years ago

amyeroberts approved these changes on 2023-11-03

Update modeling_distilbert.py

4cc2c049

Update test_modeling_distilbert.py

e6246e03

style fix

3a069143

amyeroberts merged 1ac2463d into main 2 years ago

Reviewers

amyeroberts

Assignees

No one assigned

Labels

None yet

Milestone

No milestone