DeepSpeed

parallelize writing of layer checkpoint files across data parallel instances

#1419

Merged