PR #4957 Fix the MoE-params gradient-scaling

Fix the MoE-params gradient-scaling #4957

tjruwase merged 5 commits into deepspeedai:master from RezaYazdaniAminabadi:fix-moe-grad-scaling

Fix the MoE-params gradient-scaling

ecd102f1

RezaYazdaniAminabadi requested a review from

tjruwase 2 years ago

RezaYazdaniAminabadi requested a review from

mrwyattii 2 years ago

Merge branch 'master' into fix-moe-grad-scaling

35b79795

tjruwase approved these changes on 2024-01-17

Merge branch 'master' into fix-moe-grad-scaling

a0868e3d

Merge branch 'master' into fix-moe-grad-scaling

cf2af492

Merge branch 'master' into fix-moe-grad-scaling

f8f8ef99

tjruwase merged 9d2660d2 into master 2 years ago

Reviewers

tjruwase

mrwyattii

Assignees

No one assigned

Labels

None yet

Milestone

No milestone