Fix signatures for processing kwargs (#35105)
* add conversion script
* remove pg2 refs
* fixup style
* small update
* get correct scaling
* add back missing bos
* fix missing config keys
* might revert this pos_embeddings
* fixup 9b config
* fix 9b
* fixup 9b conversion for good + add back num_hidden_layers
* add correct query scaling for 2b, 9b, 27b
* fixup 27b conversion
* Additional variant: 27b-896
* Use CPU for conversion to reduce GPU RAM requirements
* fix causal mask generation + formatting
* fix in-training causal mask generation edge case
* trigger CI
* update config
* update config
* update config
* update config
* update config
* update config
* update config
* update config
* update config
* move conversion file to main model dir
* handle multi-images + bos token
* address comments for input ids
* revert ci fixes
* [run-slow] paligemma
* fix
* [run-slow] paligemma
* skip end 2 end
* [run-slow] paligemma
---------
Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
