PR #7054 Fix, bf16 optimizer remove dup loop

Fix, bf16 optimizer remove dup loop #7054

tjruwase merged 2 commits into deepspeedai:master from wukong1992:fix-bf16-moe-refresh-params

wukong1992 requested a review from

tjruwase 1 year ago

wukong1992 requested a review from

tohtana 1 year ago

tjruwase approved these changes on 2025-02-19

wukong1992 force pushed from c0f04e26 to ec29a11f 1 year ago

Fix, bf16 with moe refresh optimizer state from bf16 ckpt errer cause…

af19de2a

wukong1992 force pushed from ec29a11f to af19de2a 1 year ago

Merge branch 'master' into fix-bf16-moe-refresh-params

e56d3801

tjruwase merged e2dc3eeb into master 1 year ago

Reviewers

tjruwase

tohtana

Assignees

No one assigned

Labels

None yet

Milestone

No milestone