DeepSpeed
[zero++] Synchronize at the end of secondary partitioning and simplify the logic
#5216
Merged

Loading