Deprecate `vocab_size` in other two VLMs (#31681)
* deprrecate `vocab_size` in other two VLMs
* Update src/transformers/models/fuyu/configuration_fuyu.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* depracate until 4.44
---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
