PR #553 Simplify dist init and only init if needed.

Simplify dist init and only init if needed. #553

jeffra merged 6 commits into master from amawa/new-aml-discovery

Simplify dist init and only init if needed.

2d3cf65a

awan-10 requested a review from

arashashari 5 years ago

awan-10 requested a review from

cli99 5 years ago

awan-10 requested a review from

conglongli 5 years ago

awan-10 requested a review from

eltonzheng 5 years ago

awan-10 requested a review from

jeffra 5 years ago

awan-10 requested a review from

minjiaz 5 years ago

awan-10 requested a review from

niumanar 5 years ago

awan-10 requested a review from

RezaYazdaniAminabadi 5 years ago

awan-10 requested a review from

samyam 5 years ago

awan-10 requested a review from

ShadenSmith 5 years ago

awan-10 requested a review from

tjruwase 5 years ago

awan-10 marked this pull request as draft 5 years ago

jeffra commented on 2020-11-24

Updates based on offline discussion.

513fc2c0

awan-10 marked this pull request as ready for review 5 years ago

Merge branch 'master' into amawa/new-aml-discovery

26bb5581

Fix the dist_init_required=True case.

3201e4ab

Merge branch 'master' into amawa/new-aml-discovery

d6c8a298

jeffra approved these changes on 2020-11-25

Info to Warning.

c3fb334a

jeffra merged 0e831e23 into master 5 years ago

mrwyattii deleted the amawa/new-aml-discovery branch 2 years ago

Reviewers

jeffra

arashashari

cli99

conglongli

eltonzheng

minjiaz

niumanar

RezaYazdaniAminabadi

samyam

ShadenSmith

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Simplify dist init and only init if needed. #553 Merged

Simplify dist init and only init if needed. #553

DeepSpeed
Simplify dist init and only init if needed.
#553

Merged