DeepSpeed
Ability to initialize distributed backend outside deepspeed runtime
#608
Merged
Overview
Commits
13
Changes
View On GitHub

Ability to initialize distributed backend outside deepspeed runtime #608

jeffra merged 13 commits into master from jeffra/callable-mpi
jeffra
jeffra refactor distributed init (relates to old PR #276)
663f00f2
jeffra remove dead code
f857fefc
jeffra jeffra requested a review from arashashari arashashari 5 years ago
jeffra jeffra requested a review from awan-10 awan-10 5 years ago
jeffra jeffra requested a review from cli99 cli99 5 years ago
jeffra jeffra requested a review from conglongli conglongli 5 years ago
jeffra jeffra requested a review from eltonzheng eltonzheng 5 years ago
jeffra jeffra requested a review from minjiaz minjiaz 5 years ago
jeffra jeffra requested a review from niumanar niumanar 5 years ago
jeffra jeffra requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
jeffra jeffra requested a review from samyam samyam 5 years ago
jeffra jeffra requested a review from ShadenSmith ShadenSmith 5 years ago
jeffra jeffra requested a review from tjruwase tjruwase 5 years ago
jeffra fix import errors
c2489807
jeffra fix another import
d8700f79
jeffra another fix, runnable now
33ec22ae
jeffra fixes for unit test backend
0587ae8a
jeffra jeffra changed the title Distributed init outside runtime init Initialize distributed backend outside deepspeed runtime 5 years ago
jeffra jeffra changed the title Initialize distributed backend outside deepspeed runtime Ability to initialize distributed backend outside deepspeed runtime 5 years ago
tjruwase
tjruwase approved these changes on 2020-12-17
jeffra update DSE
af901ea0
jeffra update mpi documentation
f0664826
jeffra formatting
5a30339a
jeffra fix warnings in cluster install script
af733a92
ShadenSmith
ShadenSmith approved these changes on 2020-12-17
jeffra add verbose flag
3ec4f252
jeffra more verbose logs
ffc67df0
jeffra switch unit test backend to use deepspeed.init_dist
2df5aa94
jeffra jeffra merged 7435b2f1 into master 5 years ago
jeffra jeffra deleted the jeffra/callable-mpi branch 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum