DeepSpeed

c520d476 - [profiling][mics]Fix some issues for log_summary(). (#3899)

[profiling][mics]Fix some issues for log_summary(). (#3899) * print_rank_0 is not defined in this python script * Enable log_summary for mics feature based on Zero_Stage 3