onnxruntime
[CUDA] Fuse MoE router bias into MatMulNBits GEMV
#29170
Merged
Overview
Commits
12
Changes
View On GitHub

[CUDA] Fuse MoE router bias into MatMulNBits GEMV #29170

kunal-vaishnavi merged 12 commits into main from tlwu/20260619/qmoe_router_bias_gemv
tianleiwu
tianleiwu [CUDA] Fuse GPT-OSS router bias into MatMulNBits GEMV
2a2ce830
tianleiwu tianleiwu force pushed from 651acb5a to 2a2ce830 21 days ago
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 21 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-06-20
tianleiwu Merge remote-tracking branch 'origin/main' into tlwu/20260619/qmoe_ro…
e3f75417
tianleiwu Require static M==1 for CUDA router bias fusion
13e6ffb4
tianleiwu Fix -Wshorten-64-to-32 error in MatMulNBitsBiasFusion test
f69cb5fd
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 20 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-06-20
tianleiwu Address review: qualify std::optional and add explicit int casts in t…
5acf8a99
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 20 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-06-20
tianleiwu add fallback
b0a4d86e
tianleiwu tianleiwu marked this pull request as ready for review 20 days ago
tianleiwu extend to qwen and gemma
25789d98
tianleiwu add doc
4f64dc59
tianleiwu tianleiwu changed the title [CUDA] Fuse GPT-OSS router bias into MatMulNBits GEMV [CUDA] Fuse MoE router bias into MatMulNBits GEMV 20 days ago
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 18 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-06-22
kunal-vaishnavi
kunal-vaishnavi commented on 2026-06-22
kunal-vaishnavi
kunal-vaishnavi commented on 2026-06-22
kunal-vaishnavi
kunal-vaishnavi commented on 2026-06-22
tianleiwu Address review: restrict router GEMV to GPT-OSS, cap bias-add grid, r…
fbff53a3
tianleiwu Merge remote-tracking branch 'origin/main' into tlwu/20260619/qmoe_ro…
5926f730
tianleiwu tianleiwu requested a review from kunal-vaishnavi kunal-vaishnavi 18 days ago
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 18 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-06-23
tianleiwu docs: fix relative source links in matmul_nbits.md
4d2bc950
tianleiwu docs+test: align router GEMV scope with code; cover block_size 64
9b23007d
tianleiwu tianleiwu requested a review from hariharans29 hariharans29 16 days ago
tianleiwu tianleiwu requested a review from apsonawane apsonawane 16 days ago
kunal-vaishnavi
kunal-vaishnavi approved these changes on 2026-06-24
kunal-vaishnavi kunal-vaishnavi merged ba45260e into main 16 days ago
kunal-vaishnavi kunal-vaishnavi deleted the tlwu/20260619/qmoe_router_bias_gemv branch 16 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum