onnxruntime
[WebGPU EP] Fuse QMoE 1-token decode path to reduce GPU dispatches
#27998
Merged

[WebGPU EP] Fuse QMoE 1-token decode path to reduce GPU dispatches #27998

guschmue merged 12 commits into main from opt/webgpu-qmoe-fused-1token
qjia7
qjia7 [WebGPU EP] Fuse QMoE 1-token decode path to reduce GPU dispatches
dea14482
qjia7 fix incorrect results
54defba2
qjia7 [WebGPU EP] Add per-row weight indirect support to DP4A SmallM and fi…
5978b03d
qjia7 Merge branch 'main' into opt/webgpu-qmoe-fused-1token
ac84f9af
qjia7 Remove ReplicateHidden: broadcast A row 0 via override_M
d70f7902
qjia7 Remove per_row_weight_indirect: simplify to has_weight_idx_indirect
f90d9f15
qjia7 Use num_tokens variable in Gate1Token dispatch for clarity
3ae0e4c2
qjia7 Use M consistently for tile optimization checks instead of dispatch_M
4a953a70
qjia7 qjia7 marked this pull request as ready for review 216 days ago
qjia7 qjia7 requested a review from guschmue guschmue 216 days ago
qjia7 qjia7 requested a review from fs-eire fs-eire 216 days ago
guschmue guschmue added ep:WebGPU
qjia7 Merge branch 'main' into opt/webgpu-qmoe-fused-1token
52d21598
qjia7 qjia7 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 214 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-10
qjia7 Address PR review: separate dispatch_M uniform, skip zero-init for 1-…
c630eeff
qjia7 Merge branch 'opt/webgpu-qmoe-fused-1token' of https://github.com/Mic…
96be6b51
qjia7 qjia7 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 214 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-10
qjia7 Add WebGPU QMoE tests: EP block in RunQMoETest + 1-token path test
9d75e321
guschmue
guschmue
guschmue approved these changes on 2026-04-10
guschmue guschmue enabled auto-merge (squash) 213 days ago
guschmue guschmue merged c36c4225 into main 213 days ago
guschmue guschmue deleted the opt/webgpu-qmoe-fused-1token branch 213 days ago
guschmue guschmue added release:1.25.1

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone