Megatron-DeepSpeed

2f3a2d68 - Merge branch 'extra_assertion' into 'main'

Merge branch 'extra_assertion' into 'main' Make sure pipeline-model-parallel size is greater than 2 for interleaved schedule See merge request ADLR/megatron-lm!253