DeepSpeed
Fix softmax dim of Residual MoE implementation in moe/layer.py
#2110
Merged

Fix softmax dim of Residual MoE implementation in moe/layer.py #2110

yaozhewei merged 2 commits into deepspeedai:master from hero007feng:master
hero007feng
fix softmax dim of Residual MoE in moe/layer.py
c593f97b
hero007feng hero007feng requested a review from jeffra jeffra 3 years ago
hero007feng hero007feng requested a review from samyam samyam 3 years ago
hero007feng hero007feng requested a review from tjruwase tjruwase 3 years ago
hero007feng hero007feng requested a review from ShadenSmith ShadenSmith 3 years ago
hero007feng hero007feng requested a review from conglongli conglongli 3 years ago
hero007feng hero007feng requested a review from awan-10 awan-10 3 years ago
hero007feng hero007feng requested a review from cli99 cli99 3 years ago
hero007feng hero007feng requested a review from eltonzheng eltonzheng 3 years ago
hero007feng hero007feng requested a review from minjiaz minjiaz 3 years ago
hero007feng hero007feng requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
hero007feng hero007feng requested a review from duli2012 duli2012 3 years ago
hero007feng hero007feng requested a review from mrwyattii mrwyattii 3 years ago
hero007feng hero007feng requested a review from yaozhewei yaozhewei 3 years ago
hero007feng hero007feng requested a review from arashb arashb 3 years ago
hero007feng hero007feng requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
hero007feng hero007feng requested a review from samadejacobs samadejacobs 3 years ago
yaozhewei Merge branch 'master' into master
ecc16693
yaozhewei yaozhewei enabled auto-merge (squash) 3 years ago
conglongli
conglongli approved these changes on 2022-07-20
yaozhewei yaozhewei merged b4513f63 into master 3 years ago

Login to write a write a comment.

Login via GitHub