PR #2250 Enable contiguous gradients with Z1+MoE

Enable contiguous gradients with Z1+MoE #2250

siddharth9820 merged 3 commits into master from patch-z1-cont-grad

Enable contiguous gradients with Z1+MoE

746c0ba3

siddharth9820 requested a review from

jeffra 3 years ago

siddharth9820 requested a review from

samyam 3 years ago

siddharth9820 requested a review from

tjruwase 3 years ago

siddharth9820 requested a review from

ShadenSmith 3 years ago

siddharth9820 requested a review from

conglongli 3 years ago

siddharth9820 requested a review from

awan-10 3 years ago

siddharth9820 requested a review from

cli99 3 years ago

siddharth9820 requested a review from

eltonzheng 3 years ago

siddharth9820 requested a review from

minjiaz 3 years ago

siddharth9820 requested a review from

RezaYazdaniAminabadi 3 years ago

siddharth9820 requested a review from

duli2012 3 years ago

siddharth9820 requested a review from

mrwyattii 3 years ago

siddharth9820 requested a review from

yaozhewei 3 years ago

siddharth9820 requested a review from

arashb 3 years ago

siddharth9820 requested a review from

xiaoxiawu-microsoft 3 years ago

siddharth9820 requested a review from

samadejacobs 3 years ago

tjruwase approved these changes on 2022-08-23

Merge branch 'master' into patch-z1-cont-grad

eb2ed0bf

siddharth9820 enabled auto-merge (squash) 3 years ago

Merge branch 'master' into patch-z1-cont-grad

b42f1a3a

jeffra approved these changes on 2022-08-23

siddharth9820 merged b288cf1b into master 3 years ago

Reviewers

jeffra

tjruwase

samyam

ShadenSmith

conglongli

awan-10

cli99

eltonzheng

minjiaz

RezaYazdaniAminabadi

duli2012

mrwyattii

yaozhewei

arashb

xiaoxiawu-microsoft

samadejacobs

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Enable contiguous gradients with Z1+MoE #2250 Merged

Enable contiguous gradients with Z1+MoE #2250

DeepSpeed
Enable contiguous gradients with Z1+MoE
#2250

Merged