DeepSpeed
Method `run_map_reduce` to fix errors when running `run_map` followed by `run_reduce`
#5131
Merged
Merged
Method `run_map_reduce` to fix errors when running `run_map` followed by `run_reduce` #5131
conglongli
merged
13 commits into
deepspeedai:master
from
run_map_reduce_in_one_call
added assert of torch vs numpy types
14f2bbe1
added check for single node reduce. added barriers
295fba67
pre-commit
56658e34
alternative implementation of PR 5130
d7565c82
bm-synth
changed the title
bm-synth
changed the title
Merge branch 'master' into run_map_reduce_in_one_call
db7630af
Update data_analyzer.py
b72c494d
Merge branch 'master' into run_map_reduce_in_one_call
18f186b0
Merge branch 'master' into run_map_reduce_in_one_call
b6443c9b
Merge branch 'master' into run_map_reduce_in_one_call
ddf3841b
Update data_analyzer.py
583b781a
Update data_analyzer.py
f9e1d71c
conglongli
approved these changes
on 2024-02-15
Merge branch 'master' into run_map_reduce_in_one_call
938970ce
disabled auto-merge 2 years ago
Manually disabled by user
Manually disabled by user
replaced torch.distributed with deepspeed.comm
bd935b62
Login to write a write a comment.
Login via GitHub