transformers
1ac2463d - [`FA2`] Add flash attention for for `DistilBert` (#26489)

Commit

2 years ago

[`FA2`] Add flash attention for for `DistilBert` (#26489) * flash attention added for DistilBert * fixes * removed padding_masks * Update modeling_distilbert.py * Update test_modeling_distilbert.py * style fix

References

#26489 - [`FA2`] Add flash attention for for `DistilBert`

#27720 - Add common processor tests

#29969 - [SigLIP] Add fast tokenizer

#32831 - [Docs] Update resources

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#62 - Add initial DEIMv2 model implementation

#65 - Fix RTDetrV2 sine position embedding ordering

#44375 - Add RF-DETR

#71 - Use Mask2Former ignore_value in mask matching and losses

#44385 - Fix make check-repo

#45082 - [VidEoMT] Update conversion script

#45110 - Add SAM 3.1

Author

susnato

Parents

5964f820

transformers 1ac2463d - [`FA2`] Add flash attention for for `DistilBert` (#26489)

transformers
1ac2463d - [`FA2`] Add flash attention for for `DistilBert` (#26489)