Refactor some core stuff (#36539)
* some config changes
* update
* current state
* update
* update
* updates and cleanup
* something that works
* fixup
* fixes
* nits
* nit
* nits and fix
* Update src/transformers/integrations/tensor_parallel.py
Co-authored-by: Lysandre Debut <hi@lysand.re>
* Update src/transformers/integrations/tensor_parallel.py
Co-authored-by: Lysandre Debut <hi@lysand.re>
* cleanup
* style
* safe import
* fix
* updates
* rename stuff an clean
* style
* small updates
* ups
* oups
* nit
* protect imports
* update tp
* rodfl
* arf
* turbo nit on init
* fix import error
* frumble gumbgle
* try to fix the import error
* should fix the non model test
* update keep in float32
* update
* fix
* nits
* fix subvconfigs
* test was weird
* nit
* fix failing test
* fix instruct blip
* fixes
* style
* x.com
* fix overwrite
* ok last bit of failing test
---------
Co-authored-by: Lysandre Debut <hi@lysand.re>
