Add Ovis2 model and processor implementation (#37088)
* Add Ovis2 model and processor implementation
* Apply style fixes
* Add unit tests for Ovis2 image processing and processor
* Refactor image processing functions for clarity and efficiency
* Add Ovis2 ImageProcessorFast
* Refactor Ovis2 code
* Refactor Ovis2 model components and update processor functionality
* Fix repo consistency issues for Ovis2: docstring, config cleanup
* Update Ovis2 model integration tests
* Update Ovis2 configuration and processing classes for improved documentation
* Remove duplicate entry for 'ovis2' in VLM_CLASS_NAMES
* Fix conflict
* Fix import order
* Update image processor class names
* Update Ovis2 model structure
* Refactor Ovis2 configuration
* Fix typos
* Refactor Ovis2 model classes and remove unused code
* Fix typos
* Refactor Ovis2 model initialization
* Fiix typos
* Remove Ovis2 model mapping from MODEL_MAPPING_NAMES in modeling_auto.py
* Add license and update type hints
* Refactor token function and update docstring handling
* Add license
* Add Ovis2 model support and update documentation
* Refactor Ovis2 model structure and enhance multimodal capabilities
* Update Ovis2 weight mapping for consistency and clarity in key patterns
* Remove unused 'grids' parameter from Ovis2 model and Update processing logic to handle image grids more efficiently.
* Refactor Ovis2 model test structure to include Ovis2Model
* Add optional disable_grouping param to Ovis2ImageProcessorFast
* Refactor type hints in Ovis2 modules
* Add licensing information in Ovis2 modules and tests
* Refactor Ovis2 model by removing unused methods
* Refactor Ovis2 model tests by renaming test classes and removing skipped tests
* Refactor Ovis2 model output classes
* Refactor Ovis2 weight conversion and Update model embedding classes
* Refactor Ovis2 model imports and remove unused functions
* Enhance vision configuration extraction in Ovis2 weight conversion
* Refactor Ovis2 model's forward method to remove interpolation option
* Update Ovis2 model documentation
* Refactor Ovis2 model input handling and tokenizer configuration
* Update return type hints in Ovis2 model
* Remove commented-out code
* fix config for tests and remove key mappings
* Update tokenizer configuration to use add_special_tokens method
* skip torchscript
* Fix image placeholder generation in Ovis2Processor
* Refactor Ovis2 model to rename visual_table to visual_embeddings_table
* Enhance Ovis2 model by adding vision_feature_select_strategy parameter
* Refactor Ovis2 model weights conversion and architecture
* Refactor Ovis2 model by removing vision_feature_select_strategy parameter
* Update Ovis2 model examples
* Refactor Ovis2 model
* Update Ovis2 model
* Update Ovis2 model configuration
* Refactor Ovis2 model test setup
* Refactor flash attention support
* Refactor
* Fix typo
* Refactor
* Refactor model classes
* Update expected output in Ovis2
* Refactor docstrings
* Fix
* Fix
* Fix
* Update input in tests
* Fix
* Fix get_decoder method
* Refactor
* Refactor Ovis2
* Fix
* Fix
* Fix test
* Add get_placeholder_mask
* Refactor Ovis2 model tests
* Fix
* Refactor
* Fix
* Fix
* Fix Ovis2 test
---------
Co-authored-by: Cyril Vallez <cyril.vallez@gmail.com>
