DeepSpeed

b4513f63 - fix softmax dim of Residual MoE in moe/layer.py (#2110)

fix softmax dim of Residual MoE in moe/layer.py (#2110) Thanks a lot for finding this issue and fixed it :) Co-authored-by: Zhewei Yao <zheweiyao@gmail.com>