DeepSpeed
[Bugfix][scheduler]: WarmupLR inherits optimizer lr when not specified
#7360
Merged
Merged