onnxruntime
WebGPU: Add indirect dispatch for flash attention graph capture to support Gemma4
#29236
Merged

WebGPU: Add indirect dispatch for flash attention graph capture to support Gemma4 #29236

feich-ms
feich-ms feich-ms requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 14 days ago
feich-ms feich-ms added ep:WebGPU
feich-ms feich-ms marked this pull request as ready for review 14 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-06-26
feich-ms feich-ms requested a review from qjia7 qjia7 14 days ago
feich-ms feich-ms force pushed from 6ae8f1f3 to 63159eb3 14 days ago
github-actions
github-actions commented on 2026-06-26
feich-ms feich-ms marked this pull request as draft 14 days ago
feich-ms feich-ms marked this pull request as ready for review 11 days ago
feich-ms feich-ms requested a review from guschmue guschmue 11 days ago
feich-ms feich-ms changed the title WebGPU: Add indirect dispatch for flash attention graph capture WebGPU: Add indirect dispatch for flash attention graph capture to support Gemma4 11 days ago
feich-ms add indirect dispatch support for graph capture
c5f03453
feich-ms webgpu: refactor indirect dispatch normalization in flash attention
2f70dec3
feich-ms webgpu: add indirect dispatch path tests for flash attention
faee205e
feich-ms webgpu: clang-format and remove verbose comment in flash attention
e5f62cde
feich-ms webgpu: fix RunGQASharedKV call sites for GqaTargetEp API change
4ee58bb0
feich-ms webgpu: fix GQA kv_empty tests to use valid total_sequence_length
9272ceb4
feich-ms webgpu: exempt kv_empty layers from graph capture share_buffer assertion
aa60c436
feich-ms webgpu: fix stale kNormalizeDispatchGroupSizeFn reference after rebase
49936038
feich-ms feich-ms force pushed from 823a2396 to 49936038 10 days ago
feich-ms webgpu: rename AppendNormalizeDispatchShader to AppendPopulateIndirec…
9cefb106
qjia7
qjia7 commented on 2026-06-30
feich-ms webgpu: inline AppendPopulateIndirectDispatchShader into its only cal…
495aac70
feich-ms webgpu: switch PrepareIndirectDispatchProgram to use total_seqlen input
bc84e8d3
feich-ms feich-ms requested a review from justinchuby justinchuby 10 days ago
qjia7 qjia7 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 10 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-06-30
qjia7
qjia7 commented on 2026-06-30
Copilot Fix kv_empty WebGPU tests: reuse EP, drop unvalidated present outputs
99c41ee3
feich-ms feich-ms requested a review from hariharans29 hariharans29 10 days ago
feich-ms webgpu: add graph capture test for kv_empty indirect dispatch
dabdf99b
qjia7
qjia7 commented on 2026-07-01
feich-ms webgpu: rewrite graph capture GQA test to exercise real ORT GC path
f99046c2
feich-ms webgpu: replay graph capture test with different inputs to verify cor…
ec1d50c5
feich-ms webgpu: move #ifdef USE_WEBGPU to wrap the whole GC test, not just body
053c2b98
qjia7
qjia7 approved these changes on 2026-07-02
hariharans29
hariharans29
hariharans29 approved these changes on 2026-07-02
justinchuby justinchuby merged d7592544 into main 8 days ago
justinchuby justinchuby deleted the user/feich/gemma4_webgpu_gc_support branch 8 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone