PR #1811 Refactor moe/non-moe gradient reduction

Refactor moe/non-moe gradient reduction #1811

tjruwase merged 2 commits into master from olruwase/simplify_engine_reduction

Refactor moe/non-moe gradient reduction

e572badb

tjruwase requested a review from

jeffra 3 years ago

tjruwase requested a review from

samyam 3 years ago

tjruwase requested a review from

ShadenSmith 3 years ago

tjruwase requested a review from

conglongli 3 years ago

tjruwase requested a review from

awan-10 3 years ago

tjruwase requested a review from

cli99 3 years ago

tjruwase requested a review from

eltonzheng 3 years ago

tjruwase requested a review from

minjiaz 3 years ago

tjruwase requested a review from

RezaYazdaniAminabadi 3 years ago

tjruwase removed review request from

jeffra 3 years ago

tjruwase removed review request from

awan-10 3 years ago

Merge branch 'master' into olruwase/simplify_engine_reduction

ef277f46

jeffra approved these changes on 2022-03-04

awan-10 approved these changes on 2022-03-05

tjruwase merged 9f7126fc into master 3 years ago

mrwyattii deleted the olruwase/simplify_engine_reduction branch 2 years ago

Reviewers

jeffra

awan-10

samyam

ShadenSmith

conglongli

cli99

eltonzheng

minjiaz

RezaYazdaniAminabadi

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Refactor moe/non-moe gradient reduction #1811 Merged

Refactor moe/non-moe gradient reduction #1811

DeepSpeed
Refactor moe/non-moe gradient reduction
#1811

Merged