DeepSpeed
fix: fixed the communication problem of pp when using sequence parallel
#4228

Open

fix: fixed the communication problem of pp when using sequence parallel #4228

LiuXTao wants to merge 1 commit into deepspeedai:master from LiuXTao:itao/fix_seq_para_with_pp

LiuXTao requested a review from

ShadenSmith 2 years ago

LiuXTao requested a review from

duli2012 2 years ago

LiuXTao requested a review from

jeffra 2 years ago

LiuXTao requested a review from

tjruwase 2 years ago

fix: fixed the communication problem of pp when using sequence parallel

5b2a8f30

LiuXTao force pushed from 700c2530 to 5b2a8f30 2 years ago

Reviewers

ShadenSmith

duli2012

jeffra

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone