onnxruntime
Add CrossAttention operator
#14146
Merged

Add CrossAttention operator #14146

tianleiwu merged 16 commits into main from tlwu/qkv_to_context
tianleiwu
tianleiwu Add QkvToContext
77a629e9
tianleiwu draft
d5e03cd6
tianleiwu Merge branch 'tlwu/qkv_to_context' of https://github.com/Microsoft/on…
1d43f6b9
tianleiwu add key_padding_mask
b4239f32
tianleiwu update doc
00c1e6e8
tianleiwu Merge branch 'main' into tlwu/qkv_to_context
4bb9a453
tianleiwu fix doc
4bf800b5
tianleiwu tianleiwu requested a review from yufenglee yufenglee 3 years ago
tianleiwu tianleiwu requested a review from gh-yewang gh-yewang 3 years ago
tianleiwu tianleiwu marked this pull request as draft 3 years ago
tianleiwu optional value in packed kv
e9ab1e2e
tianleiwu value/bias required, remove packed kv
740daf3f
tianleiwu fix build
7c09f014
tianleiwu fix dummy mask
f4b276c1
tianleiwu Merge branch 'main' into tlwu/qkv_to_context
930bae8c
tianleiwu update doc
0484d755
tianleiwu tianleiwu marked this pull request as ready for review 3 years ago
tianleiwu update shape inference
8df74474
tianleiwu tianleiwu changed the title [WIP] Add CrossAttention operator Add CrossAttention operator 3 years ago
tianleiwu fix build
6c0201ed
tianleiwu fix rocm build
ae7f454c
yufenglee
yufenglee approved these changes on 2023-01-06
gh-yewang
gh-yewang commented on 2023-01-06
gh-yewang
gh-yewang commented on 2023-01-06
gh-yewang
gh-yewang approved these changes on 2023-01-06
tianleiwu tianleiwu merged 2cacb24c into main 3 years ago
tianleiwu tianleiwu deleted the tlwu/qkv_to_context branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone