onnxruntime
optimization for whisper model with decoder masked multihead attention
#15827

Merged

optimization for whisper model with decoder masked multihead attention #15827

zhanghuanrong merged 7 commits into main from zhalei/whisper-pr

github-advanced-security commented on 2023-05-06

zhanghuanrong force pushed from 90186c4f to 16efe74a 2 years ago

zhanghuanrong requested a review from

wangyems 2 years ago

zhanghuanrong requested a review from

hariharans29 2 years ago

zhanghuanrong requested a review from

yufenglee 2 years ago

yufenglee commented on 2023-05-15

Support whisper model to use MaskedDecoderMultiheadAttention

c4cbce67

fix py lint warning

ab5945da

fix change fail unit test

763fc305

zhanghuanrong force pushed from f0c071c8 to 763fc305 2 years ago

yufenglee commented on 2023-05-16

Fix som pr feedback

bdf3281d

Fix bug caused by remove optional attention mask

2ad6ac93

Fix bug during adding initial decoder ids

40925961

docs update

e20ad994

yufenglee approved these changes on 2023-05-17

zhanghuanrong merged 0f8e66d9 into main 2 years ago

zhanghuanrong deleted the zhalei/whisper-pr branch 2 years ago

Reviewers

yufenglee

wangyems

hariharans29

Assignees

No one assigned

Labels

None yet

Milestone

No milestone