transformers
751cff7c - Add EoMT with DINOv3 backbone (#41212)

Commit
28 days ago
Add EoMT with DINOv3 backbone (#41212) * Add EoMT DINOv3 model * Add EoMT-DINOv3 conversion script * Refine EoMT-DINOv3 conversion to support timm backbones * Fix DINOv3 conversion key mapping * Add debug trace for EoMT-DINOv3 verification * Fix EoMT-DINOv3 verification mapping * Remove script * Fix attention mask dtype in EoMT-DINOv3 converter verification * Align verification attention mask with decoder gating * Update conversion script * Remove custom image processor * Update docs * Improve conversion script, make fixup * Update docstring * Refactor EoMT-DINOv3 modular integration * Refine EoMT segmentation dropout handling and DINOv3 reuse * Fix conversion * Improve inheritance * Make fixup * Address comment * Address comment * Fix eager attention masking for EoMT DINOv3 * Fix eager attention * Fix merge, make fixup * Fix tests * Make fixup * Address comments * Update year * Add integration tests * Convert semantic as well * Transfer checkpoints * Remove script * Update date * Address comments * Use super()._init_weights * Address comment * Address comment * Make fix-repo * Address comment * Improve integration test * Simplify eomt * Update eomt * Remove test_attention_outputs * Undo changes * Make fix-repo * Update date * Address comment * Add comment * Use RopeParameters * Address comment * Revert doc * Update integration test * Add comment * Refine EOMT-DINOv3 integration with config improvements and API updates - Update configuration initialization order to set attributes before calling super().__init__ - Add RotaryEmbeddingConfigMixin to modular config for proper RoPE parameter handling - Add original_inv_freq buffer to RopePositionEmbedding for compatibility - Fix check_model_inputs decorator usage (remove parentheses) - Update documentation to use AutoModelForUniversalSegmentation - Add copyright header to conversion script - Fix test configuration with explicit rope_theta parameter Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * clear * Address comment * quick modular fix for config * Make fix-repo * Address comment * some rope fixes and config things * wow this was ugly * new attn way * Make fix-repo * last fixes --------- Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com> Co-authored-by: vasqu <antonprogamer@gmail.com> Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
Author
Parents
Loading