transformers
Add Ovis2 model and processor implementation
#37088
Merged
Overview
Commits
110
Changes
View On GitHub

Add Ovis2 model and processor implementation #37088

Cyrilvallez merged 110 commits into huggingface:main from thisisiron:add-ovis2
thisisiron
github-actions github-actions marked this pull request as draft 314 days ago
github-actions
thisisiron thisisiron marked this pull request as ready for review 311 days ago
github-actions github-actions requested a review from ArthurZucker ArthurZucker 311 days ago
github-actions github-actions requested a review from Rocketknight1 Rocketknight1 311 days ago
thisisiron thisisiron changed the title [WIP] Add Ovis2 model and processor implementation Add Ovis2 model and processor implementation 311 days ago
ArthurZucker ArthurZucker requested a review from Cyrilvallez Cyrilvallez 311 days ago
ArthurZucker
ArthurZucker ArthurZucker added New model
thisisiron
thisisiron Add Ovis2 model and processor implementation
b3bfa35d
thisisiron Apply style fixes
51c9efd3
thisisiron Add unit tests for Ovis2 image processing and processor
98915086
thisisiron Refactor image processing functions for clarity and efficiency
fde1b2a7
thisisiron Add Ovis2 ImageProcessorFast
6b0e5d47
thisisiron Refactor Ovis2 code
6b8ae7ea
thisisiron Refactor Ovis2 model components and update processor functionality
91f72b21
thisisiron Fix repo consistency issues for Ovis2: docstring, config cleanup
aacbab35
thisisiron Update Ovis2 model integration tests
7305a22d
thisisiron Update Ovis2 configuration and processing classes for improved docume…
355a91cd
thisisiron thisisiron force pushed from 725e76af to 355a91cd 311 days ago
thisisiron Remove duplicate entry for 'ovis2' in VLM_CLASS_NAMES
ac232e05
thisisiron Fix conflict
16d71f89
thisisiron Fix import order
a7b5094e
thisisiron Update image processor class names
4d560431
Cyrilvallez
Cyrilvallez commented on 2025-04-18
thisisiron Update Ovis2 model structure
7f1cbc0d
thisisiron Refactor Ovis2 configuration
a4e37e65
thisisiron Merge remote-tracking branch 'upstream/main' into add-ovis2
11a2a095
thisisiron Fix typos
59996598
thisisiron Refactor Ovis2 model classes and remove unused code
f66426c8
thisisiron Fix typos
ae1ea0db
thisisiron Refactor Ovis2 model initialization
4e540b53
thisisiron Fiix typos
83a7cca7
thisisiron
thisisiron thisisiron requested a review from Cyrilvallez Cyrilvallez 275 days ago
Cyrilvallez
Cyrilvallez commented on 2025-05-28
thisisiron Merge branch 'main' into add-ovis2
234edb2a
thisisiron Remove Ovis2 model mapping from MODEL_MAPPING_NAMES in modeling_auto.py
db597773
thisisiron Add license and update type hints
b604a701
thisisiron Refactor token function and update docstring handling
f26717d6
thisisiron Add license
890abdca
thisisiron Merge branch 'main' into add-ovis2
97e84a4d
thisisiron Merge branch 'main' into add-ovis2
67a45ab6
ArthurZucker
ArthurZucker commented on 2025-06-02
thisisiron Merge branch 'main' into add-ovis2
764e74f0
thisisiron thisisiron requested a review from Cyrilvallez Cyrilvallez 246 days ago
Cyrilvallez
Cyrilvallez commented on 2025-06-16
thisisiron Add Ovis2 model support and update documentation
178fc10f
thisisiron Refactor Ovis2 model structure and enhance multimodal capabilities
2e278a4d
thisisiron Update Ovis2 weight mapping for consistency and clarity in key patterns
17afef9c
thisisiron Remove unused 'grids' parameter from Ovis2 model and Update processin…
1a87ab35
thisisiron Refactor Ovis2 model test structure to include Ovis2Model
f3c498e0
thisisiron Merge branch 'main' into add-ovis2
ec0ffd56
thisisiron Add optional disable_grouping param to Ovis2ImageProcessorFast
0f418e86
thisisiron Refactor type hints in Ovis2 modules
afd50aa8
thisisiron thisisiron requested a review from Cyrilvallez Cyrilvallez 227 days ago
thisisiron
Cyrilvallez
thisisiron Add licensing information in Ovis2 modules and tests
bdbcb229
Cyrilvallez
Cyrilvallez commented on 2025-06-25
thisisiron Refactor Ovis2 model by removing unused methods
cd369a67
thisisiron Refactor Ovis2 model tests by renaming test classes and removing skip…
b459f505
thisisiron Merge branch 'main' into add-ovis2
4ae2f709
thisisiron Refactor Ovis2 model output classes
57abe357
thisisiron Refactor Ovis2 weight conversion and Update model embedding classes
541dc7f7
thisisiron Merge branch 'main' into add-ovis2
5e7846ca
thisisiron Refactor Ovis2 model imports and remove unused functions
d13eaea5
thisisiron Enhance vision configuration extraction in Ovis2 weight conversion
a10e3db6
thisisiron Refactor Ovis2 model's forward method to remove interpolation option
0501e0f2
thisisiron thisisiron requested a review from Cyrilvallez Cyrilvallez 222 days ago
thisisiron Update Ovis2 model documentation
c19231f8
yaswanth19
thisisiron
Cyrilvallez
thisisiron Merge branch 'main' into add-ovis2
60831410
thisisiron Refactor Ovis2 model input handling and tokenizer configuration
c27bf250
thisisiron Merge branch 'main' into add-ovis2
58c0c0a7
thisisiron Update return type hints in Ovis2 model
94fd529e
thisisiron Merge branch 'main' into add-ovis2
8402244a
thisisiron Remove commented-out code
2cd3837e
thisisiron
Cyrilvallez fix config for tests and remove key mappings
1a5f6a99
Cyrilvallez
github-actions
Cyrilvallez
thisisiron Update tokenizer configuration to use add_special_tokens method
e9197221
thisisiron Merge branch 'main' into add-ovis2
2de5a941
thisisiron Merge branch 'add-ovis2' of https://github.com/thisisiron/transformer…
e7e24641
Cyrilvallez
github-actions
Cyrilvallez skip torchscript
d9a8599b
Cyrilvallez
github-actions
thisisiron Fix image placeholder generation in Ovis2Processor
94ba3aae
thisisiron Merge branch 'add-ovis2' of https://github.com/thisisiron/transformer…
8392223d
thisisiron Merge branch 'main' into add-ovis2
0f19c79b
thisisiron
yaswanth19
yaswanth19 commented on 2025-07-09
thisisiron Refactor Ovis2 model to rename visual_table to visual_embeddings_table
d335aaac
Cyrilvallez
thisisiron Enhance Ovis2 model by adding vision_feature_select_strategy parameter
91e924ca
thisisiron Refactor Ovis2 model weights conversion and architecture
3b02fe1d
thisisiron Refactor Ovis2 model by removing vision_feature_select_strategy param…
73761609
thisisiron Merge branch 'main' into add-ovis2
683d3e99
thisisiron Update Ovis2 model examples
a8ffbd4e
yaswanth19
yaswanth19 commented on 2025-07-09
Cyrilvallez
thisisiron Refactor Ovis2 model
432a7183
yaswanth19
thisisiron
thisisiron Update Ovis2 model
1d4a1e96
thisisiron Update Ovis2 model configuration
933cadda
thisisiron Merge branch 'main' into add-ovis2
9ecdd76b
thisisiron Refactor Ovis2 model test setup
c024a105
thisisiron Merge branch 'main' into add-ovis2
5fb78702
thisisiron Merge branch 'main' into add-ovis2
3fcdb3a0
thisisiron Refactor flash attention support
a48468a5
thisisiron Merge branch 'main' into add-ovis2
5b021656
thisisiron Refactor
b5b2eb6c
thisisiron Fix typo
5e9c276e
thisisiron Refactor
0f3163ac
thisisiron Refactor model classes
0c13cfc8
thisisiron Update expected output in Ovis2
8d495eee
thisisiron Refactor docstrings
9d995c38
thisisiron Fix
ccfdb43a
thisisiron Merge branch 'main' into add-ovis2
192cc10a
thisisiron Fix
cfe3a3b8
thisisiron Fix
530aad06
thisisiron Update input in tests
5d928257
thisisiron Merge branch 'main' into add-ovis2
7bb0e2bb
thisisiron Fix
c4a83b61
thisisiron Merge branch 'main' into add-ovis2
ac31c2a7
thisisiron Fix get_decoder method
7b780295
thisisiron Refactor
c230e725
thisisiron Refactor Ovis2
3b0a94a8
thisisiron Merge branch 'main' into add-ovis2
7cff46ba
thisisiron Fix
9afdbad3
thisisiron Fix
bd69fb59
thisisiron Fix test
3ed0cb67
thisisiron Add get_placeholder_mask
2b0621cf
thisisiron Merge branch 'main' into add-ovis2
11802a43
thisisiron Merge branch 'main' into add-ovis2
38b6f15a
thisisiron
Cyrilvallez
Cyrilvallez commented on 2025-08-13
Cyrilvallez
github-actions
thisisiron Refactor Ovis2 model tests
0e7d6edf
thisisiron Fix
7ce5c4e1
thisisiron Refactor
0c6571d1
thisisiron Merge branch 'main' into add-ovis2
13010fae
thisisiron Fix
2773182d
thisisiron Fix
8642f7d8
thisisiron
Cyrilvallez
github-actions
Cyrilvallez
thisisiron Fix Ovis2 test
62f2023e
thisisiron Merge branch 'main' into add-ovis2
dd47f25b
github-actions
thisisiron
Cyrilvallez
github-actions
Cyrilvallez
Cyrilvallez Cyrilvallez merged 47938f8f into main 171 days ago
thisisiron

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
New model
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum