DeepSpeed
fix MegatronLayerPolicy to be compatible with the newest ParallelTransformerLayer
#4236
Merged
Merged