llm-foundry
Added torch_dmoe defaults, bug fixes for 2D inputs
#1210
Merged
Overview
Commits
31
Changes
View On GitHub

Added torch_dmoe defaults, bug fixes for 2D inputs #1210

snarayan21 merged 31 commits into main from saaketh/moe_defaults
snarayan21
snarayan21 defaults for torch dmoe match mb dmoe
1a52a06c
snarayan21 defaults for torch dmoe match mb dmoe
67ca3898
snarayan21 defaults for torch dmoe match mb dmoe
87660846
snarayan21 defaults for torch dmoe match mb dmoe
74664fca
snarayan21 defaults for torch dmoe match mb dmoe
49ffa615
snarayan21 defaults for torch dmoe match mb dmoe
fa5c1e41
snarayan21 defaults for torch dmoe match mb dmoe
3fcaa072
snarayan21 top k proper
fc27c599
snarayan21 permute fix
676331b3
snarayan21 permute fix
c9f83d36
snarayan21 permute fix
189e0233
snarayan21 permute fix
b3c9a8d0
snarayan21 permute fix
419ea28f
snarayan21 narrow down world size bug
0bc078e0
snarayan21 narrow down world size bug
ad3a22ad
snarayan21 narrow down world size bug
c34be692
snarayan21 narrow down world size bug
2353b7e3
snarayan21 narrow down world size bug
81b3c312
snarayan21 narrow down world size bug
250047b4
snarayan21 narrow down world size bug
981f5946
snarayan21 narrow down world size bug
a53dbb7a
snarayan21 narrow down world size bug
3aff4093
snarayan21 narrow down world size bug
d6553bef
snarayan21 narrow down world size bug
89fd113b
snarayan21 narrow down world size bug
761a942c
snarayan21 narrow down world size bug
f388896e
snarayan21 narrow down world size bug
cc750827
snarayan21 blocking dimension bug
1886608c
snarayan21 done
d6ae5188
snarayan21 snarayan21 requested a review from dakinggg dakinggg 1 year ago
snarayan21 snarayan21 removed review request from dakinggg dakinggg 1 year ago
snarayan21 snarayan21 requested a review from mvpatel2000 mvpatel2000 1 year ago
snarayan21 snarayan21 requested a review from dakinggg dakinggg 1 year ago
snarayan21 snarayan21 requested a review from b-chu b-chu 1 year ago
snarayan21 snarayan21 requested a review from irenedea irenedea 1 year ago
dakinggg dakinggg requested a review from bigning bigning 1 year ago
snarayan21 yo
98a1443d
mvpatel2000
mvpatel2000 commented on 2024-05-15
mvpatel2000
snarayan21 yo
bfd6b7c8
bigning
bigning approved these changes on 2024-05-15
snarayan21 snarayan21 merged b4146269 into main 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum