DeepSpeed
[MiCS] [Bugfix] set self.save_non_zero_checkpoint=True only for first partition group
#3787
Merged
Merged