transformers
e2e393c6 - [`t5`] Fix T5 inference in `float16` + `bnb` error (#21281)

Commit

3 years ago

[`t5`] Fix T5 inference in `float16` + `bnb` error (#21281) * attempts to fix: - upcast input for `T5DenseActDense` - add the condition `self.wo.weight.dtype != torch.int8` - added tests on `test/mixed_int8` - `make fixup` * fix ci test

References

#21281 - [`t5`] Fix T5 inference in `float16` + `bnb` error

#27720 - Add common processor tests

#29969 - [SigLIP] Add fast tokenizer

#32831 - [Docs] Update resources

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#39821 - Support MetaCLIP 2

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#41212 - Add EoMT with DINOv3 backbone

#62 - Add initial DEIMv2 model implementation

Author

younesbelkada

Parents

f424b094

transformers e2e393c6 - [`t5`] Fix T5 inference in `float16` + `bnb` error (#21281)

transformers
e2e393c6 - [`t5`] Fix T5 inference in `float16` + `bnb` error (#21281)