DeepSpeed
re-introduce: stage3: efficient compute of scaled_global_grad_norm
#5493
Merged
Merged