DeepSpeed
Fix for stage3 when setting different communication data type
#4540
Merged
Merged