Add FastVLM (#41112)
* Added an initial conversion script
* Added a modular where FastVLM is different from LlaVA
* Improved the conversion script
* Adjusted the conversion script
* Removed redundant labels from FastViT & improved the template
* Added docs and changed default config
* Fix default config
* Fix default config
* Fixed layer feature handling and more docs
* Fixed documentation
* Style fixed
* Some small fixes
* Improved the example script to be more inclusive
* Fixes after the rebase
* Made the code and docs more readable and consistent
* Some fixes from the review
* Reverted back to last layer only
* Typos fixed
* added initial tests - some still failing
* Style and quality fixes
* Updated modular according to the review
* Tests passing and some suggested generic improvements
* Docs updated with another usage tip and an auto model
* Reversed changes to test_can_intialize_on_meta becuase it's not fully compatible with one existing model
* Some tweaks
* Typo fix
* Consistency fixed
* Review comment
* Redundant config attr deleted
* Consistency fixed
* Fixed integration tests after rebase
---------
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: Raushan Turganbay <raushan@huggingface.co>
