transformers

1573af48 - fix idefics3 generation issues (#49738)

fix idefics3 generation issues (#49738) * fix idefics3 generation issues * fix colmodernvbert * BOOM goes the override * add comment * and 2 other models * flakiness --------- Co-authored-by: raushan <raushan@huggingface.co>