openvino
[ONNX FE][Transformation] GroupQueryAttention refine work for static shape, make valid kv left aligned [use select with mask]
#35679
Open
Overview
Commits
3
Changes
View On GitHub

[ONNX FE][Transformation] GroupQueryAttention refine work for static shape, make valid kv left aligned [use select with mask] #35679

bopeng1234 wants to merge 3 commits into openvinotoolkit:master from bopeng1234:onnx_gqa_refine_select_with_mask
bopeng1234
bopeng1234 initial refine work fro ONNX GQA, insert new kv into the past kv, val…
c6034ace
bopeng1234 add ScatterUpdate method, NPU will hang with that
f2f179c9
bopeng1234 remove scatterupdate, keep select with mask
c9a2bef1
bopeng1234 bopeng1234 added do not merge
github-actions github-actions added category: transformations

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
category: transformations do not merge
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum