openvino
[ONNX FE][Transformation] GroupQueryAttention refine work for static shape, make valid kv left aligned [use select with mask]
#35679
Open
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
3
Changes
View On
GitHub
[ONNX FE][Transformation] GroupQueryAttention refine work for static shape, make valid kv left aligned [use select with mask]
#35679
bopeng1234
wants to merge 3 commits into
openvinotoolkit:master
from
bopeng1234:onnx_gqa_refine_select_with_mask
initial refine work fro ONNX GQA, insert new kv into the past kv, val…
c6034ace
add ScatterUpdate method, NPU will hang with that
f2f179c9
remove scatterupdate, keep select with mask
c9a2bef1
bopeng1234
added
do not merge
github-actions
added
category: transformations
Login to write a write a comment.
Login via GitHub
Reviewers
No reviews
Assignees
No one assigned
Labels
category: transformations
do not merge
Milestone
No milestone
Login to write a write a comment.
Login via GitHub