DeepSpeed
add moe topk(k>2) gate support
#5881
Merged
Overview
Commits
8
Changes
View On GitHub

add moe topk(k>2) gate support #5881

tohtana merged 8 commits into deepspeedai:master from inkcherry:topk_2
inkcherry
inkcherry Mingzhi/topk prob (#28)
feb505c2
inkcherry refine
153af8e2
inkcherry remove empty line
80a0c5f2
inkcherry inkcherry requested a review from awan-10 awan-10 1 year ago
inkcherry inkcherry requested a review from tjruwase tjruwase 1 year ago
inkcherry inkcherry requested a review from loadams loadams 1 year ago
tjruwase tjruwase requested a review from tohtana tohtana 1 year ago
tjruwase tjruwase removed review request from awan-10 awan-10 1 year ago
tjruwase tjruwase removed review request from loadams loadams 1 year ago
tjruwase Merge branch 'master' into topk_2
6a2b7675
inkcherry fix format
3bea84b8
loadams Merge branch 'master' into topk_2
5582faf7
loadams Merge branch 'master' into topk_2
e9409e2a
tohtana
tohtana approved these changes on 2024-08-15
tohtana Merge branch 'master' into topk_2
cda9dd7f
tohtana tohtana enabled auto-merge 1 year ago
tohtana
tohtana tohtana merged 9a3ede70 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum