PR #2007 Relax DeepSpeed MoE ZeRO-1 Assertion

Relax DeepSpeed MoE ZeRO-1 Assertion #2007

jeffra merged 2 commits into master from qanthony/moe-fix

Relax assertion to allow Megatron-DeepSpeed MoE to use ZeRO-1

56fbe7c1

Quentin-Anthony requested a review from

jeffra 3 years ago

Quentin-Anthony requested a review from

samyam 3 years ago

Quentin-Anthony requested a review from

tjruwase 3 years ago

Quentin-Anthony requested a review from

ShadenSmith 3 years ago

Quentin-Anthony requested a review from

conglongli 3 years ago

Quentin-Anthony requested a review from

awan-10 3 years ago

Quentin-Anthony requested a review from

cli99 3 years ago

Quentin-Anthony requested a review from

eltonzheng 3 years ago

Quentin-Anthony requested a review from

minjiaz 3 years ago

Quentin-Anthony requested a review from

RezaYazdaniAminabadi 3 years ago

tjruwase approved these changes on 2022-06-10

Merge branch 'master' into qanthony/moe-fix

ce327650

jeffra merged 25b2fc29 into master 3 years ago

jeffra deleted the qanthony/moe-fix branch 3 years ago

Reviewers

tjruwase

jeffra

samyam

ShadenSmith

conglongli

awan-10

cli99

eltonzheng

minjiaz

RezaYazdaniAminabadi

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Relax DeepSpeed MoE ZeRO-1 Assertion #2007 Merged

Relax DeepSpeed MoE ZeRO-1 Assertion #2007

DeepSpeed
Relax DeepSpeed MoE ZeRO-1 Assertion
#2007

Merged