Remove `cache_position` in more models (2) (#44602)
* bert and the likes
* NO COPIED FROM IN MODULAR IT IS AUTOMATIC
* more more
* idefics
* more
* t5 and the likes
* fix and simplify the t5s
* fix random test
* review comments
* those got added in between but were previously removed
* this random signature test again...
* CI