PR #2250 Enable contiguous gradients with Z1+MoE

Enable contiguous gradients with Z1+MoE #2250

siddharth9820 merged 3 commits into master from patch-z1-cont-grad

Enable contiguous gradients with Z1+MoE

746c0ba3

siddharth9820 requested a review from

jeffra 4 years ago

siddharth9820 requested a review from

samyam 4 years ago

siddharth9820 requested a review from

tjruwase 4 years ago

siddharth9820 requested a review from

ShadenSmith 4 years ago

siddharth9820 requested a review from

conglongli 4 years ago

siddharth9820 requested a review from

awan-10 4 years ago

siddharth9820 requested a review from

cli99 4 years ago

siddharth9820 requested a review from

eltonzheng 4 years ago

siddharth9820 requested a review from

minjiaz 4 years ago

siddharth9820 requested a review from

RezaYazdaniAminabadi 4 years ago

siddharth9820 requested a review from

duli2012 4 years ago

siddharth9820 requested a review from

mrwyattii 4 years ago

siddharth9820 requested a review from

yaozhewei 4 years ago

siddharth9820 requested a review from

arashb 4 years ago

siddharth9820 requested a review from

xiaoxiawu-microsoft 4 years ago

siddharth9820 requested a review from

samadejacobs 4 years ago

tjruwase approved these changes on 2022-08-23

Merge branch 'master' into patch-z1-cont-grad

eb2ed0bf

siddharth9820 enabled auto-merge (squash) 4 years ago

Merge branch 'master' into patch-z1-cont-grad

b42f1a3a

jeffra approved these changes on 2022-08-23

siddharth9820 merged b288cf1b into master 4 years ago

Reviewers

jeffra

tjruwase

samyam

ShadenSmith

conglongli

awan-10

cli99

eltonzheng

minjiaz

RezaYazdaniAminabadi

duli2012

mrwyattii

yaozhewei

arashb

xiaoxiawu-microsoft

samadejacobs

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Enable contiguous gradients with Z1+MoE #2250 Merged

Enable contiguous gradients with Z1+MoE #2250

DeepSpeed
Enable contiguous gradients with Z1+MoE
#2250

Merged