DeepSpeed

Unmanaged gradient accumulation: ZeRO stage 2 support

#8203

Merged