deepspeed.init_distributed() support for TCP protocols #2905
jeffra
merged
8 commits into
deepspeedai:master
from
noabauma:master
adding small fix to use init_method for tcp protocolls
dae6b62a
default values set to -1 for rank and world_size
b199392f
Merge branch 'master' into master
7a2a5d8b
modify TorchBackend initialization to accept rank and world_size
307ac24f
adding code documentation in deepspeed.init_distributed()
c94901b6
jeffra
approved these changes
on 2023-03-07
Merge branch 'master' into master
4f2083f0
formatting
6d1acdc4
Merge branch 'master' into master
94c5aa9d
Login to write a write a comment.
Login via GitHub