onnxruntime
[WebGPU/JSEP] Support group query attention do_rotary attribute
#23524
Merged
Overview
Commits
15
Changes
View On GitHub

[WebGPU/JSEP] Support group query attention do_rotary attribute #23524

satyajandhyala merged 15 commits into main from sajandhy/webgpu_group_query_attention_do_rotary
satyajandhyala
satyajandhyala Added do_rotary attribute support to GQA.
361df45c
satyajandhyala Apply rotary embedding before transposing to to BNSH
cc317ca4
satyajandhyala Merge branch 'main' of https://github.com/microsoft/onnxruntime into …
c95b8468
satyajandhyala minor changes.
7952ddb9
satyajandhyala Merge branch 'main' of https://github.com/microsoft/onnxruntime into …
ba0d6399
satyajandhyala Merge branch 'main' of https://github.com/microsoft/onnxruntime into …
3241118e
satyajandhyala A fixed the pos_id type.
a95c3d85
satyajandhyala minor change
845469b7
satyajandhyala Fixed hint for generate positionIDs.
d829e71d
satyajandhyala Merge branch 'main' of https://github.com/microsoft/onnxruntime into …
4edf220d
satyajandhyala minor bug
49b765e2
satyajandhyala Merge branch 'main' of https://github.com/microsoft/onnxruntime into …
2bc125aa
satyajandhyala satyajandhyala requested a review from guschmue guschmue 1 year ago
satyajandhyala satyajandhyala marked this pull request as ready for review 1 year ago
satyajandhyala satyajandhyala marked this pull request as draft 1 year ago
satyajandhyala satyajandhyala added ep:WebGPU
satyajandhyala Merge branch 'main' of https://github.com/microsoft/onnxruntime into …
85ce62a6
satyajandhyala Fixed GeneratePositionIds code.
ee39ae0e
satyajandhyala satyajandhyala marked this pull request as ready for review 1 year ago
satyajandhyala lint
c2a83360
satyajandhyala satyajandhyala changed the title [WIP][WebGPU/JSEP] Support group query attention do_rotary attribute [WebGPU/JSEP] Support group query attention do_rotary attribute 1 year ago
satyajandhyala satyajandhyala requested a review from fs-eire fs-eire 1 year ago
guschmue
guschmue approved these changes on 2025-03-07
satyajandhyala satyajandhyala merged 333fbdb4 into main 1 year ago
satyajandhyala satyajandhyala deleted the sajandhy/webgpu_group_query_attention_do_rotary branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ep:WebGPU
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum