PR #28185 Add CPU QMoE 2-bit support and LUT GEMM fast path

Add CPU QMoE 2-bit support and LUT GEMM fast path #28185

tianleiwu merged 25 commits into main from tlwu/qmoe_2bit_cpu

Add 2 bit QMoE

b7e9fd80

Add LuT GEMM for 2 bits

ae555a3e

Add doc

16ca1f98

tianleiwu marked this pull request as draft 123 days ago

Add doc gen

620d057f

upload docs

c4597096

Merge remote-tracking branch 'origin/main' into tlwu/win_gpu_doc_gen_…

c0596535

Merge remote-tracking branch 'origin/main' into tlwu/qmoe_2bit_cpu

e1f24368

Merge remote-tracking branch 'origin/tlwu/win_gpu_doc_gen_workflow' i…

9eeb2775

Merge remote-tracking branch 'origin/main' into tlwu/qmoe_2bit_cpu

1825452d

tianleiwu requested a review from

copilot-pull-request-reviewer 112 days ago

tianleiwu requested a review from

apsonawane 112 days ago

copilot-pull-request-reviewer commented on 2026-05-03

fix: address review feedback for QMoE 2-bit CPU support

dcb3a68f

github-actions commented on 2026-05-03

lintrunner

e7f814fa

tianleiwu requested a review from

copilot-pull-request-reviewer 112 days ago

copilot-pull-request-reviewer commented on 2026-05-03

address feedbacks

07d4d43a

tianleiwu requested a review from

copilot-pull-request-reviewer 112 days ago

copilot-pull-request-reviewer commented on 2026-05-03

update comment

ecc98f01

tianleiwu marked this pull request as ready for review 112 days ago

tianleiwu requested a review from

vraspar 111 days ago

apsonawane commented on 2026-05-05

vraspar commented on 2026-05-05

fix: address review feedback for 2-bit QMoE CPU support

6acd4a6e

tianleiwu requested a review from

copilot-pull-request-reviewer 110 days ago

tianleiwu requested a review from

vraspar 110 days ago

copilot-pull-request-reviewer commented on 2026-05-05

fix: align dequant block size to zp_pack_size for row-wise asymmetric…

3185da90

test: add regression test for 2-bit row-wise asymmetric ZP alignment

c14f41da

tianleiwu requested a review from

copilot-pull-request-reviewer 110 days ago

tianleiwu requested a review from

apsonawane 110 days ago

test: fix QMoETest_CPU_Int2_MLAS missing swiglu_fusion attribute

bfd89717

copilot-pull-request-reviewer commented on 2026-05-06

fix: correct test comment and doc block-wise shape formulas

5da077fe

Merge remote-tracking branch 'origin/main' into tlwu/qmoe_2bit_cpu

3511b177

update doc

10370dcf

tianleiwu requested a review from

copilot-pull-request-reviewer 109 days ago

copilot-pull-request-reviewer commented on 2026-05-06

vraspar commented on 2026-05-06

fix(cpu): remove redundant MlasInitLutGemmKernelConfig in TryRunLutGemm

b380eb3c

tianleiwu requested a review from

vraspar 108 days ago

update doc

ba731ad0

vraspar commented on 2026-05-11

vraspar dismissed these changes on 2026-05-11

address feedbacks

2be976a2

tianleiwu dismissed their stale review via 2be976a2 104 days ago

tianleiwu requested a review from

vraspar 104 days ago

tianleiwu requested a review from

copilot-pull-request-reviewer 104 days ago

copilot-pull-request-reviewer commented on 2026-05-11

Merge remote-tracking branch 'origin/main' into tlwu/qmoe_2bit_cpu

b0de83db

Address feedbacks

7830ec38

vraspar approved these changes on 2026-05-12

tianleiwu enabled auto-merge (squash) 103 days ago

tianleiwu merged dac5a143 into main 103 days ago

tianleiwu deleted the tlwu/qmoe_2bit_cpu branch 103 days ago

Reviewers

vraspar

apsonawane

github-actions

copilot-pull-request-reviewer

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

onnxruntime Add CPU QMoE 2-bit support and LUT GEMM fast path #28185 Merged

Add CPU QMoE 2-bit support and LUT GEMM fast path #28185

onnxruntime
Add CPU QMoE 2-bit support and LUT GEMM fast path
#28185

Merged