onnxruntime
Support T5 in BeamSearch operator
#11450
Merged

Support T5 in BeamSearch operator #11450

tianleiwu merged 45 commits into master from EncoderDecoderBeamSearch
tianleiwu
tianleiwu change interface of BeamSearch op
698c6631
tianleiwu Merge remote-tracking branch 'origin/master' into EncoderDecoderBeamS…
23c1e38d
tianleiwu update interface for cpu
75d91685
tianleiwu update decoder i/o names
ee950f1e
tianleiwu Add comments for subgraph inputs/outputs
c4580d06
tianleiwu int64 inputs
261106e2
tianleiwu move cpu state out of InitBeamState
0a4f2a39
tianleiwu tianleiwu marked this pull request as draft 3 years ago
tianleiwu fix linux build
f2a31ca2
tianleiwu fix cuda build
dfc2db31
lgtm-com
tianleiwu tianleiwu added model:t5
tianleiwu encoder subgraph dynamic axes to fixed dim value
5c321a88
lgtm-com
tianleiwu Merge remote-tracking branch 'origin/master' into EncoderDecoderBeamS…
9287bd32
tianleiwu add --separate_encoder_and_decoder_init
beddbd77
tianleiwu correct name t5-3B => t5-3b, t5-11B => t5-11b
9ad1ec42
tianleiwu fix export
59042e7f
tianleiwu Merge branch 'EncoderDecoderBeamSearch' of https://github.com/microso…
71bd39c0
lgtm-com
tianleiwu update comments
56306319
tianleiwu Enable dump
c5687c9e
lgtm-com
tianleiwu update sequence length, and no position for T5
691cd4e7
lgtm-com
tianleiwu update decoder inputs
71aaba98
tianleiwu include header with directory
bc28320d
pommedeterresautee
tianleiwu fix line_length>120 and spelling errors
664c75cc
tianleiwu make sure line_length <= 120
2eb4ba31
lgtm-com
tianleiwu fix cpplint warnings
2d331d3a
tianleiwu include relative path
219479fe
lgtm-com
lgtm-com
tianleiwu Merge branch 'EncoderDecoderBeamSearch' of https://github.com/microso…
25397bf5
tianleiwu add --use_int32_inputs in convert t5 to onnx
6777f47d
tianleiwu update cuda device helper to use int32 inputs
237546f8
tianleiwu
lgtm-com
tianleiwu Fix lint warnings
9ae72530
tianleiwu Merge remote-tracking branch 'origin/master' into EncoderDecoderBeamS…
ea4963d7
tianleiwu Merge branch 'EncoderDecoderBeamSearch' of https://github.com/microso…
ae0e72dd
lgtm-com
tianleiwu use constexpr for past input/output index
235f63d1
tianleiwu initial sequence length 1
3f180fe3
tianleiwu fix ORT_ENFORCE of hypothesis_buffer_offset_
fb5c5d7e
lgtm-com
tianleiwu init sequence from decoder_input_ids in cpu
9b2c4d0b
lgtm-com
tianleiwu Merge branch 'EncoderDecoderBeamSearch' of https://github.com/microso…
28b934e9
tianleiwu fix cuda error
dd1aee23
tianleiwu fix linux build
313a3b5e
lgtm-com
tianleiwu add tests and default int32 inputs
ac6b9e63
tianleiwu Merge branch 'EncoderDecoderBeamSearch' of https://github.com/Microso…
c3beb847
lgtm-com
tianleiwu add more tests; allow t5 in one step
29deedb0
tianleiwu update for lint warning
221a0522
tianleiwu tianleiwu requested a review from viboga viboga 3 years ago
tianleiwu tianleiwu requested a review from wangyems wangyems 3 years ago
tianleiwu tianleiwu changed the title [WIP] Support T5 in BeamSearch operator Support T5 in BeamSearch operator 3 years ago
tianleiwu remove useless comment
05142ff1
tianleiwu tianleiwu marked this pull request as ready for review 3 years ago
lgtm-com
tianleiwu update comments; disable dump
d3cff625
lgtm-com
wangyems
wangyems commented on 2022-06-08
tianleiwu add comments
13f113d9
wangyems
wangyems commented on 2022-06-08
lgtm-com
wangyems wangyems requested a review from wangyems wangyems 3 years ago
wangyems
wangyems dismissed these changes on 2022-06-09
tianleiwu address review feedback
84e4729d
tianleiwu tianleiwu dismissed their stale review via 84e4729d 3 years ago
wangyems
wangyems commented on 2022-06-10
lgtm-com
wangyems wangyems requested a review from wangyems wangyems 3 years ago
wangyems
wangyems approved these changes on 2022-06-10
tianleiwu tianleiwu merged def78a1b into master 3 years ago
tianleiwu tianleiwu deleted the EncoderDecoderBeamSearch branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone