Fix, bf16 optimizer remove dup loop (#7054)
bf16 with moe refresh optimizer state from bf16 ckpt will raise
IndexError: list index out of range
Signed-off-by: shaomin <wukon1992@gmail.com>
Co-authored-by: shaomin <wukon1992@gmail.com>
Co-authored-by: Hongwei Chen <33092912+hwchen2017@users.noreply.github.com>
