transformers

Fix hyperparameter search when optuna+deepseed

#34642

Merged