DeepSpeed

Set tp to 1 when MPU is None for bf16 optimizer

#5245

Open