transformers
d4bd33cc - Register ModelOutput subclasses as supported torch.utils._pytree nodes (#25358)

Commit

2 years ago

Register ModelOutput subclasses as supported torch.utils._pytree nodes (#25358) * Register ModelOutput subclasses as supported torch.utils._pytree nodes Fixes #25357 where DDP with static_graph=True does not sync gradients when calling backward() over tensors contained in ModelOutput subclasses * Add test for torch pytree ModelOutput serialization and deserialization

References

#62 - Add initial DEIMv2 model implementation

#58 - Add EoMT DINOv3 model

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#27720 - Add common processor tests

#32831 - [Docs] Update resources

#29969 - [SigLIP] Add fast tokenizer

#41212 - Add EoMT with DINOv3 backbone

#39821 - Support MetaCLIP 2

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#25358 - Register ModelOutput subclasses as supported torch.utils._pytree nodes

Author

Matthew Hoffman

Parents

a23ac36f

transformers d4bd33cc - Register ModelOutput subclasses as supported torch.utils._pytree nodes (#25358)

transformers
d4bd33cc - Register ModelOutput subclasses as supported torch.utils._pytree nodes (#25358)