DeepSpeed

49d399cd - Fixing bf16 test (#3551)

Fixing bf16 test (#3551) * Fixing bf16 test that was missing a config. * Chaning train_batch_size to train_micro_batch_size_per_gpu * Chaning all train_batch_size to train_micro_batch_size_per_gpu