DeepSpeed

4e67e8b0 - Fixing bf16 test (#3551)

Fixing bf16 test (#3551) * Fixing bf16 test that was missing a config. * Chaning train_batch_size to train_micro_batch_size_per_gpu * Chaning all train_batch_size to train_micro_batch_size_per_gpu