pastValue …
#21782

Merged

[JS/WebGPU] Avoid producing presentKey/presentValue outputs if pastKey/pastValue … #21782

satyajandhyala merged 8 commits into main from sajandhy/wepu_fix_attention_output

Avoid producing presentKey/presentValue outputs if pastKey/pastValue …

18a39066

satyajandhyala marked this pull request as ready for review 1 year ago

satyajandhyala requested a review from

fs-eire 1 year ago

satyajandhyala added ep:WebGPU

Don't treat empty inputs as undefined in MHA. Let Attention deal with…

9e225640

satyajandhyala marked this pull request as draft 1 year ago

satyajandhyala requested a review from

guschmue 1 year ago

Feed pastKey/pastValue inputs down to the functions that generate sha…

c01f721c

Added a test case with zero-size pastKey/pastValue inputs that requir…

c8b187ff

Added back the assumption comment.

d0b0627b

satyajandhyala marked this pull request as ready for review 1 year ago

ShapeUtis.size should return 0 if the tensor dims is empty instead of 1.

d8aeee17

Revert "ShapeUtis.size should return 0 if the tensor dims is empty in…

7520dc24

tianleiwu commented on 2024-08-19

Reverted changes preventing shape error checking.

c0d72a4e

satyajandhyala requested a review from

tianleiwu 1 year ago

guschmue approved these changes on 2024-08-19

satyajandhyala merged 1fb2e71d into main 1 year ago

satyajandhyala deleted the sajandhy/wepu_fix_attention_output branch 1 year ago

Reviewers

guschmue

tianleiwu

fs-eire

Assignees

No one assigned

Labels

ep:WebGPU

Milestone

No milestone