onnxruntime
[CUDA] Add LinearAttentionGate and GatedRMSNorm contrib operators
#31158
Open

[CUDA] Add LinearAttentionGate and GatedRMSNorm contrib operators #31158

tianleiwu wants to merge 12 commits into main from tlwu/20260730/linear_attention_gates
tianleiwu
github-advanced-security
github-advanced-security commented on 2026-07-30
tianleiwu tianleiwu force-pushed the tlwu/20260730/state_window_ops branch from 5b6d5dba to 264c0802 6 days ago
tianleiwu [CUDA/CPU/WebGPU] Add state_window to LinearAttention and CausalConvW…
837e57bd
tianleiwu [CUDA] Add LinearAttentionGate and GatedRMSNorm contrib operators
8456e570
tianleiwu tianleiwu force pushed from 01026ce0 to 8456e570 6 days ago
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 6 days ago
tianleiwu tianleiwu requested a review from apsonawane apsonawane 6 days ago
tianleiwu tianleiwu removed review request from apsonawane apsonawane 6 days ago
tianleiwu tianleiwu requested a review from justinchuby justinchuby 6 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-07-31
tianleiwu tianleiwu changed the base branch from tlwu/20260730/state_window_ops to main 6 days ago
tianleiwu fix(cuda): register bfloat16 LinearAttentionGate/GatedRMSNorm kernels
9df39a68
tianleiwu fix build errors
0671f8e7
tianleiwu Fix test
426d5815
tianleiwu fix test (skip if no cuda ep)
1ce5b08f
tianleiwu Merge remote-tracking branch 'origin/main' into tlwu/20260730/linear_…
c68838cc
tianleiwu Fix CUDA linear attention input validation
741f953c
tianleiwu Avoid gate launch block count overflow
783ab6fb
github-actions
github-actions commented on 2026-08-01
lintrunner
f3f2ae02
tianleiwu tianleiwu marked this pull request as ready for review 4 days ago
tianleiwu tianleiwu requested a review from apsonawane apsonawane 4 days ago
tianleiwu tianleiwu requested a review from hariharans29 hariharans29 4 days ago
tianleiwu tianleiwu requested a review from kunal-vaishnavi kunal-vaishnavi 4 days ago
tianleiwu update doc
e0cad08b
justinchuby
tianleiwu Merge remote-tracking branch 'origin/main' into tlwu/20260730/linear_…
5d5d331a

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone