Fix, pipeline model with moe cause error when send grad #7055
wukong1992
wants to merge
2 commits into
deepspeedai:master
from
wukong1992:fix-pipe-act-grad-comm
Fix, pipeline model with moe, send and recv grad use same buffer will…
080095bb
Merge branch 'master' into fix-pipe-act-grad-comm
fbd7182b
Login to write a write a comment.
Login via GitHub