Don't convert to `safetensors` on the fly if the call is from testing (#41194)
* don't convert
* disable
* Update src/transformers/modeling_utils.py
Co-authored-by: Cyril Vallez <cyril.vallez@huggingface.co>
* fix
* disable
* disable
* disable
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Cyril Vallez <cyril.vallez@huggingface.co>