DeepSpeed

Add arctic model support by adding w2 to all_reduce

#6856

Merged