Fixes configuration default values (#43592)
* fixes it finally I hope for all models!
* tie word embeddings!
* vision LLMs
* Apply repo consistency fixes
* Apply repo consistency fixes
* revert VLMs
* unpleasant bug
* fix repo
* skip it
* llava mismatch
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
