Update MoE and qMoE spec #25619
update moe spec
e7cb8448
tianleiwu
marked this pull request as draft 207 days ago
update doc
bd36de44
format
1d70f69d
add swiglu limit
451814f9
Merge branch 'main' into tlwu/moe_spec
fa0224cd
CPU change from apsonawane
4a0d84f4
use moe_helper in CPU
03a61467
remove MoEQuantType
6a5871e8
Fix build
c4eb332a
Add swiglu parameters
08c31146
Merge branch 'main' into tlwu/moe_spec
b7de4a7c
update doc
edd065cb
improve backward compatible
1b72088f
tianleiwu
marked this pull request as ready for review 206 days ago
Revert "emsdk" change
b1562ddc
refacotring
37abf5d5
Disable cpu qmoe test
0635f113
tianleiwu
merged
562760a5
into main 206 days ago
tianleiwu
deleted the tlwu/moe_spec branch 206 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub