Add EoMT with DINOv3 backbone (#41212)
* Add EoMT DINOv3 model
* Add EoMT-DINOv3 conversion script
* Refine EoMT-DINOv3 conversion to support timm backbones
* Fix DINOv3 conversion key mapping
* Add debug trace for EoMT-DINOv3 verification
* Fix EoMT-DINOv3 verification mapping
* Remove script
* Fix attention mask dtype in EoMT-DINOv3 converter verification
* Align verification attention mask with decoder gating
* Update conversion script
* Remove custom image processor
* Update docs
* Improve conversion script, make fixup
* Update docstring
* Refactor EoMT-DINOv3 modular integration
* Refine EoMT segmentation dropout handling and DINOv3 reuse
* Fix conversion
* Improve inheritance
* Make fixup
* Address comment
* Address comment
* Fix eager attention masking for EoMT DINOv3
* Fix eager attention
* Fix merge, make fixup
* Fix tests
* Make fixup
* Address comments
* Update year
* Add integration tests
* Convert semantic as well
* Transfer checkpoints
* Remove script
* Update date
* Address comments
* Use super()._init_weights
* Address comment
* Address comment
* Make fix-repo
* Address comment
* Improve integration test
* Simplify eomt
* Update eomt
* Remove test_attention_outputs
* Undo changes
* Make fix-repo
* Update date
* Address comment
* Add comment
* Use RopeParameters
* Address comment
* Revert doc
* Update integration test
* Add comment
* Refine EOMT-DINOv3 integration with config improvements and API updates
- Update configuration initialization order to set attributes before calling super().__init__
- Add RotaryEmbeddingConfigMixin to modular config for proper RoPE parameter handling
- Add original_inv_freq buffer to RopePositionEmbedding for compatibility
- Fix check_model_inputs decorator usage (remove parentheses)
- Update documentation to use AutoModelForUniversalSegmentation
- Add copyright header to conversion script
- Fix test configuration with explicit rope_theta parameter
Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
* clear
* Address comment
* quick modular fix for config
* Make fix-repo
* Address comment
* some rope fixes and config things
* wow this was ugly
* new attn way
* Make fix-repo
* last fixes
---------
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: vasqu <antonprogamer@gmail.com>
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>