DeepSpeed

325c6c5e - DeepCompile ZeRO-3: robust allgather for uneven shards; fix profiling… (#7489)

DeepCompile ZeRO-3: robust allgather for uneven shards; fix profiling… (#7489) … meta key (max_mem) --------- Signed-off-by: Abhishek <dalakotiashu150@gmail.com> Signed-off-by: Masahiro Tanaka <mtanaka@anyscale.com> Co-authored-by: Abhishek <dalakotiashu150@gmail.com> Co-authored-by: Masahiro Tanaka <mtanaka@anyscale.com>