PR #25530 [CUDA] Support SwiGlu in MoE and qMoE

[CUDA] Support SwiGlu in MoE and qMoE #25530

tianleiwu merged 6 commits into main from tlwu/moe_swiglu

support swiglu

755e33c7

only build interleaved version

514b072d

Update qMoE

63d8808d

tianleiwu changed the title ~~[CUDA] Support SwiGlu in MoE~~ [CUDA] Support SwiGlu in MoE and qMoE 226 days ago

Update operator doc

e24271e8

static cast

4c07bcf6

add test for 4 bits

360f4d0e

apsonawane approved these changes on 2025-07-28

tianleiwu merged a2b4546c into main 225 days ago

tianleiwu deleted the tlwu/moe_swiglu branch 225 days ago

jywu-msft added release:1.23.0

tianleiwu added cherry-picked

tianleiwu removed release:1.23.0

Reviewers

apsonawane

Assignees

No one assigned

Labels

cherry-picked

Milestone

No milestone