transformers

3437d121 - [Trainer/Deepspeed] handle get_last_lr() before first step() (#10362)

[Trainer/Deepspeed] handle get_last_lr() before first step() (#10362) * handle get_last_lr() before first step() * abstract away the lr getting logic * cleanup * add test * move to utils