Fix CI and update Transformers (4.51.1) (#2225)
* limit diffusers
* test
* test
* using transformers cached file(s) for better and less redundant handling of the hub
* str subfolder
* error
* use path
* fix more
* only except transformers env error
* fix
* include fix from transformers 4.50
* silence tflite a bit
* fix linalg matrix norm
* fix dpt
* update trabsformers
* revert
* update
* mock triton_pre_mlir
* more user agents
* fix
* fix datasets user agent and use transformers patch
* fix
* fix and accelerate whisper testing
* fix whisper, dpt, and use main transformers
* revert dpt export model and use patched transformers
* comment flaubert qa
* pip install wheel
* again
* revert doc builder changes