onnxruntime
GQA unfused attention with FP32 QK accumulation (fixes #28195)
#28198

Merged

GQA unfused attention with FP32 QK accumulation (fixes #28195) #28198

tianleiwu merged 8 commits into main from tlwu/unfused_gqa

GQA unfused attention with FP32 QK accumulation (fixes #28195)

99aa8b22

tianleiwu requested a review from

copilot-pull-request-reviewer 22 days ago

tianleiwu requested a review from

titaiwangms 22 days ago

copilot-pull-request-reviewer commented on 2026-04-23

review feedback

4fa20eff

titaiwangms commented on 2026-04-23

fix: address review feedback - SafeInt AlignTo, y_bnsh H_v, ORT_ENFORCE

eeec5123

fix: address review summary feedback - SafeInt, logging, tests, v_hea…

b0f71ac0

Add C++ tests for GQA unfused attention with large head_size

778ee069

github-actions commented on 2026-04-23

titaiwangms commented on 2026-04-23

feedbacks

6354c525

titaiwangms commented on 2026-04-24

address feedback

158a004d

titaiwangms dismissed these changes on 2026-04-24

fix build

0fcde9a9

tianleiwu dismissed their stale review via 0fcde9a9 21 days ago

tianleiwu requested a review from

titaiwangms 21 days ago

titaiwangms approved these changes on 2026-04-25

tianleiwu merged 997c4798 into main 20 days ago

tianleiwu deleted the tlwu/unfused_gqa branch 20 days ago

Reviewers

titaiwangms

github-actions

Assignees

No one assigned

Labels

None yet

Milestone

No milestone