DeepSpeed
Only call Init Distributed if required
#734
Merged

Only call Init Distributed if required #734

jeffra merged 3 commits into deepspeedai:master from fix/init_dist
SeanNaren
Only initialize distributed if required
44679a9c
SeanNaren SeanNaren requested a review from arashashari arashashari 5 years ago
SeanNaren SeanNaren requested a review from awan-10 awan-10 5 years ago
SeanNaren SeanNaren requested a review from cli99 cli99 5 years ago
SeanNaren SeanNaren requested a review from conglongli conglongli 5 years ago
SeanNaren SeanNaren requested a review from eltonzheng eltonzheng 5 years ago
SeanNaren SeanNaren requested a review from jeffra jeffra 5 years ago
SeanNaren SeanNaren requested a review from minjiaz minjiaz 5 years ago
SeanNaren SeanNaren requested a review from niumanar niumanar 5 years ago
SeanNaren SeanNaren requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
SeanNaren SeanNaren requested a review from samyam samyam 5 years ago
SeanNaren SeanNaren requested a review from ShadenSmith ShadenSmith 5 years ago
SeanNaren SeanNaren requested a review from tjruwase tjruwase 5 years ago
jeffra Merge branch 'master' into fix/init_dist
d99f3e3c
jeffra Merge branch 'master' into fix/init_dist
83e5af1a
jeffra
jeffra approved these changes on 2021-02-11
jeffra jeffra merged 59eed176 into master 5 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone