onnxruntime
Add RotaryEmbedding fusion for Qwen3 on-the-fly RoPE patterns
#27590

Merged

Add RotaryEmbedding fusion for Qwen3 on-the-fly RoPE patterns #27590

tianleiwu merged 6 commits into microsoft:main from Rishi-Dave:rishidave/feat/qwen3-rotary-embedding-fusion

github-advanced-security commented on 2026-03-09

tianleiwu requested a review from

copilot-pull-request-reviewer 94 days ago

copilot-pull-request-reviewer commented on 2026-03-10

tianleiwu requested a review from

copilot-pull-request-reviewer 94 days ago

copilot-pull-request-reviewer commented on 2026-03-10

tianleiwu dismissed these changes on 2026-03-11

Rishi-Dave dismissed their stale review via 190c66e9 92 days ago

Rishi-Dave force pushed from 09507b2a to 190c66e9 92 days ago

Rishi-Dave force pushed from 190c66e9 to 0ed87852 91 days ago

Rishi-Dave force pushed from 0ed87852 to bfc0ffcc 90 days ago

Add RotaryEmbedding fusion for Qwen3 on-the-fly RoPE patterns

40b5bbc6

Address review feedback: fix max_seq_len, inv_freq tracing, simplify …

6b2828d5

Fix Where node traversal, use numpy_helper, remove dead params

0d528d7f

Skip cache recomputation and add consumer-check for node removal

2c7812fb

Revert SkipLayerNorm fallback and update Qwen3 test expectations

cf553d82

Add negative test and numerical validation for Qwen3 RoPE fusion

41f3a175

Rishi-Dave force pushed from 78dc48f8 to 41f3a175 89 days ago

tianleiwu requested a review from

copilot-pull-request-reviewer 88 days ago

copilot-pull-request-reviewer commented on 2026-03-16

tianleiwu approved these changes on 2026-03-16

tianleiwu enabled auto-merge (squash) 88 days ago

tianleiwu merged 227c3d5e into main 88 days ago

Reviewers

tianleiwu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone