DeepSpeed

76847f42 - Add warmup_type arguments in WarmupLR and WarmupDecayLR (#1530)

Add warmup_type arguments in WarmupLR and WarmupDecayLR (#1530) * Add warmup_type arguments in WarmupLR and WarmupDecayLR * Add warmup_type unit test * replace hardcoded constants with global vars Co-authored-by: Jeff Rasley <jerasley@microsoft.com> Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>