DeepSpeed

4524b8db - Fix for Zero3 when MP>1 and at least one batch param undefined (#2289)

Fix for Zero3 when MP>1 and at least one batch param undefined (#2289) Co-authored-by: anthony.301 <anthony.301@mri.cluster> Co-authored-by: Jeff Rasley <jerasley@microsoft.com>