PR #25319 [CPU] GQA supports attention scores output

[CPU] GQA supports attention scores output #25319

derdeljan-msft merged 12 commits into main from derdeljan/attention_scores_buffer

derdeljan-msft requested a review from

tianleiwu 166 days ago

derdeljan-msft requested a review from

jywu-msft 166 days ago

derdeljan-msft requested a review from

kunal-vaishnavi 166 days ago

derdeljan-msft requested a review from

aciddelgado 166 days ago

derdeljan-msft assigned

derdeljan-msft 166 days ago

github-advanced-security commented on 2025-07-07

kunal-vaishnavi commented on 2025-07-08

gramalingam commented on 2025-07-08

aciddelgado dismissed these changes on 2025-07-08

derdeljan-msft requested a review from

aciddelgado 164 days ago

derdeljan-msft requested a review from

kunal-vaishnavi 164 days ago

derdeljan-msft requested a review from

gramalingam 164 days ago

derdeljan-msft force pushed from 245ca5ea to 2cee47f1 164 days ago

derdeljan-msft requested a review from

fs-eire 164 days ago

kunal-vaishnavi commented on 2025-07-09

derdeljan-msft force pushed from 63029d2b to 3c7849c3 163 days ago

derdeljan-msft changed the title ~~Allow GQA to output attention scores~~ [CPU] GQA supports attention scores output 163 days ago

Allow GQA to output attention scores

18044ed9

derdeljan-msft force pushed from 3c7849c3 to 18044ed9 163 days ago

Fix docs

4b3b58f6

derdeljan-msft requested a review from

kunal-vaishnavi 163 days ago

kunal-vaishnavi commented on 2025-07-10

Update attribute comments and docs

457da697

Fix docs pipeline

52968c3d

derdeljan-msft requested a review from

kunal-vaishnavi 162 days ago

kunal-vaishnavi commented on 2025-07-11

Update parameter ordering

78f1ad5c

tianleiwu commented on 2025-07-14

Update shape of output QK

7e1c79e9

derdeljan-msft requested a review from

tianleiwu 159 days ago

Fix shape inference

ff96255b

gramalingam commented on 2025-07-14

more shape guards

9bd2d8de

Fix qk_output attr default value

65b4ab44

fix docs

8dd0ecd5

derdeljan-msft requested a review from

kunal-vaishnavi 158 days ago

derdeljan-msft requested a review from

gramalingam 158 days ago

kunal-vaishnavi commented on 2025-07-15

tianleiwu commented on 2025-07-15

fix PR comments

8d4e7228

derdeljan-msft requested a review from

tianleiwu 158 days ago

derdeljan-msft requested a review from

kunal-vaishnavi 158 days ago

tianleiwu dismissed these changes on 2025-07-15

kunal-vaishnavi dismissed these changes on 2025-07-15

kunal-vaishnavi dismissed their stale review 158 days ago

Requested changes have now been made

fix docs

a0f1d48f

derdeljan-msft dismissed their stale review via a0f1d48f 158 days ago

derdeljan-msft requested a review from

kunal-vaishnavi 158 days ago

derdeljan-msft requested a review from

tianleiwu 158 days ago

kunal-vaishnavi approved these changes on 2025-07-15

tianleiwu approved these changes on 2025-07-15

derdeljan-msft merged c7250f4d into main 157 days ago

derdeljan-msft deleted the derdeljan/attention_scores_buffer branch 157 days ago

Reviewers

tianleiwu

kunal-vaishnavi

gramalingam

fs-eire

aciddelgado

github-advanced-security

jywu-msft

Assignees

derdeljan-msft

Labels

None yet

Milestone

No milestone

onnxruntime [CPU] GQA supports attention scores output #25319 Merged

[CPU] GQA supports attention scores output #25319

onnxruntime
[CPU] GQA supports attention scores output
#25319

Merged