onnxruntime
Allow generic pipeline to accept some params for cross attention
#16519

Merged

Allow generic pipeline to accept some params for cross attention #16519

cloudhan merged 2 commits into main from guangyunhan/cross-attn-opt

cloudhan requested a review from

abudup 2 years ago

cloudhan requested a review from

PeixuanZuo 2 years ago

cloudhan requested a review from

tianleiwu 2 years ago

cloudhan force pushed from 05bbc1dd to e897d1b9 2 years ago

Allow generic pipeline to accept some params for cross attention

77da4f66

cloudhan force pushed from 011c5590 to 867c79a9 2 years ago

Allow GenericPipelines to accept k,v buffer with BNMH layout

7b034544

cloudhan force pushed from 867c79a9 to 7b034544 2 years ago

PeixuanZuo approved these changes on 2023-07-12

cloudhan merged af89496f into main 2 years ago

cloudhan deleted the guangyunhan/cross-attn-opt branch 2 years ago

Reviewers

PeixuanZuo

abudup

tianleiwu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone