Megatron-DeepSpeed

23632ee5 - Merge branch 'interleaved_bugfix' into 'main'

Merge branch 'interleaved_bugfix' into 'main' Small bugfix to make sure refactored code works with interleaved schedule See merge request ADLR/megatron-lm!256