DeepSpeed

4224015c - Fix local rank mismatch for heterogeneous nodes (#3409)

Fix local rank mismatch for heterogeneous nodes (#3409) Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com> Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>