DeepSpeed

76953a37 - fix opt-350m shard loading issue in AutoTP (#3600)

fix opt-350m shard loading issue in AutoTP (#3600) Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> Co-authored-by: Jeff Rasley <jerasley@microsoft.com> Co-authored-by: Reza Yazdani <44502768+RezaYazdaniAminabadi@users.noreply.github.com>