DeepSpeed
Introduce all_reduce_hook to support gradient aggregation across replica groups.
#7764
Open
Open
Introduce all_reduce_hook to support gradient aggregation across replica groups. #7764
zhengchenyu
wants to merge
3 commits into
deepspeedai:master
from
zhengchenyu:allreduce.hook
Introduce all_reduce_hook to support gradient aggregation across repl…
67950ee5
Merge branch 'master' into allreduce.hook
94c81e53
Merge branch 'master' into allreduce.hook
da0d71c4
Login to write a write a comment.
Login via GitHub