transformers

6227078d - HPO: keep the original logic if there's only one process, pass the trial to trainer (#19096)

HPO: keep the original logic if there's only one process, pass the trial to trainer (#19096) need to find out solution for following cases *if we need to use trial in model_init, how to do it for non-main rank, sync the model with rank0 in app? *how to use optuna prune feature for DDP, if we do it in rank0, how does other rank know it. Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>