onnxruntime
[CUDA] Add option to use DecoderMaskedMultiheadAttention in BeamSearch
#14990
Merged
Overview
Commits
41
Changes
View On GitHub

[CUDA] Add option to use DecoderMaskedMultiheadAttention in BeamSearch #14990

hariharans29 merged 41 commits into main from hari/scratch_5
hariharans29
hariharans29 Initial commit
4d41bf5b
hariharans29 Change - 1
d56afff8
hariharans29 Change - 2
80bb3c4b
hariharans29 Change - 3
efab199f
hariharans29 Change -4
058c5bb5
hariharans29 Change - 5
89b7c2bb
hariharans29 Change - 6
f915a393
hariharans29 Change - 7
2ebdd2b2
hariharans29 Change - 8
946371ae
hariharans29 Change - 9
9932efc5
hariharans29 Change - 9.1
1e9000fb
hariharans29 Change - 9.2
b462a647
hariharans29 Change - 10
4419828a
hariharans29 Change - 11
1ebd0e30
hariharans29 Change - 12
6e6a7408
hariharans29 Change - 13
701b4be1
hariharans29 Change - 14
1c612310
hariharans29 Change - 15
4e21961f
hariharans29 Change - 16
ad57765c
hariharans29 Change - 17
95629f0e
hariharans29 More changes
3bfac9bf
hariharans29 Fix builds
acd6e4ce
hariharans29 Fix builds
09c123aa
hariharans29 Support head size 128
f2a013ae
hariharans29 Nit
96504bfb
hariharans29 Try fix builds
46844e2b
hariharans29 Add initial support for BeamSearch
058c3fef
hariharans29 Beam Search commit 2
b7df0556
hariharans29 Beam Search commit 2.1
72ec735f
hariharans29 Beam Search commit 3
66e90897
hariharans29 Beam Search commit 4
7dbca89b
hariharans29 More changes
9f36c871
hariharans29 hariharans29 requested a review from wangyems wangyems 3 years ago
hariharans29 hariharans29 requested a review from zhanghuanrong zhanghuanrong 3 years ago
hariharans29 hariharans29 requested a review from tianleiwu tianleiwu 3 years ago
hariharans29 hariharans29 requested a review from yufenglee yufenglee 3 years ago
hariharans29
hariharans29 commented on 2023-03-10
hariharans29
hariharans29 commented on 2023-03-10
hariharans29
hariharans29 commented on 2023-03-10
hariharans29
hariharans29 commented on 2023-03-10
hariharans29
hariharans29 commented on 2023-03-10
hariharans29
hariharans29 commented on 2023-03-10
hariharans29
hariharans29 commented on 2023-03-10
hariharans29
hariharans29 commented on 2023-03-10
hariharans29
hariharans29 commented on 2023-03-10
hariharans29
hariharans29 commented on 2023-03-10
hariharans29
hariharans29 commented on 2023-03-10
hariharans29 Nits
37bb8fe2
hariharans29 Fix build
e8238520
hariharans29
hariharans29 commented on 2023-03-10
hariharans29 Fix builds
99b3729d
hariharans29
hariharans29 commented on 2023-03-10
hariharans29 Update docs
1e38cc29
tianleiwu
tianleiwu commented on 2023-03-10
tianleiwu
tianleiwu commented on 2023-03-10
tianleiwu
tianleiwu commented on 2023-03-10
wangyems
wangyems
wangyems commented on 2023-03-13
wangyems
wangyems commented on 2023-03-13
hariharans29
yufenglee
yufenglee dismissed these changes on 2023-03-14
wangyems
hariharans29 PR feedback
197d4ba9
hariharans29 hariharans29 dismissed their stale review via 197d4ba9 3 years ago
wangyems
wangyems dismissed these changes on 2023-03-15
hariharans29 Fix typo
77269108
hariharans29 hariharans29 dismissed their stale review via 77269108 3 years ago
hariharans29 Fix missing comma
f848125d
hariharans29 Merge remote-tracking branch 'origin/main' into hari/scratch_5
b7d98395
hariharans29 Update docs
8c1bee82
tianleiwu
tianleiwu approved these changes on 2023-03-15
hariharans29 hariharans29 merged ed7ab166 into main 3 years ago
hariharans29 hariharans29 deleted the hari/scratch_5 branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum