DeepSpeed

0ec11daa - Add more synchronizations and barriers for the multi-gpu inference case (#1309)

Add more synchronizations and barriers for the multi-gpu inference case (#1309) * add more synchronizations and barriers for resolving gpu-halt issue * removing unuseful broadcasts