Megatron-DeepSpeed

1b3dfa2f - Use torch.cuda.synchronize() right after calling batch_isend_irecv() communication API