DeepSpeed

b62e0cc5 - Add gradient_average flag support for sparse grads (#2188)

Add gradient_average flag support for sparse grads (#2188) * Add gradient_average flag support for sparse grads * formatting fixes * Add tests Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>