PR #7054 Fix, bf16 optimizer remove dup loop

Commits

Fix, bf16 with moe refresh optimizer state from bf16 ckpt errer cause loop dup

shaomin committed 1 year ago
Merge branch 'master' into fix-bf16-moe-refresh-params

hwchen2017 committed 1 year ago

DeepSpeed Fix, bf16 optimizer remove dup loop #7054 Merged