transformers
285a4801 - Fix gradient checkpointing + fp16 autocast for most models (#24247)

Commit

2 years ago

Fix gradient checkpointing + fp16 autocast for most models (#24247) * fix gc bug * continue PoC on OPT * fixes * :exploding_head: * fix tests * remove pytest.mark * fixup * forward contrib credits from discussions * forward contrib credits from discussions * reverting changes on untouched files. --------- Co-authored-by: zhaoqf123 <zhaoqf123@users.noreply.github.com> Co-authored-by: 7eu7d7 <7eu7d7@users.noreply.github.com>

References

#62 - Add initial DEIMv2 model implementation

#58 - Add EoMT DINOv3 model

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#27720 - Add common processor tests

#32831 - [Docs] Update resources

#29969 - [SigLIP] Add fast tokenizer

#41212 - Add EoMT with DINOv3 backbone

#39821 - Support MetaCLIP 2

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#24247 - Fix gradient checkpointing + fp16 autocast for most models

Author

younesbelkada

Parents

1815d186

transformers 285a4801 - Fix gradient checkpointing + fp16 autocast for most models (#24247)

transformers
285a4801 - Fix gradient checkpointing + fp16 autocast for most models (#24247)