DeepSpeed

4a0b1032 - Enforce nccl/rccl alignment of start location of each shard (#1564)

Enforce nccl/rccl alignment of start location of each shard (#1564) * Enforce nccl/rccl alignment of start location of each shard * Making yapf happy Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>