DeepSpeed

b354c28b - polishing timers and log_dist (#3996)

polishing timers and log_dist (#3996) Co-authored-by: Alexander Jipa <azzhipa@amazon.com> Co-authored-by: Jeff Rasley <jerasley@microsoft.com> Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>