Support T5 in BeamSearch operator #11450
change interface of BeamSearch op
698c6631
Merge remote-tracking branch 'origin/master' into EncoderDecoderBeamS…
23c1e38d
update interface for cpu
75d91685
update decoder i/o names
ee950f1e
Add comments for subgraph inputs/outputs
c4580d06
int64 inputs
261106e2
move cpu state out of InitBeamState
0a4f2a39
tianleiwu
marked this pull request as draft 3 years ago
fix linux build
f2a31ca2
fix cuda build
dfc2db31
encoder subgraph dynamic axes to fixed dim value
5c321a88
Merge remote-tracking branch 'origin/master' into EncoderDecoderBeamS…
9287bd32
add --separate_encoder_and_decoder_init
beddbd77
correct name t5-3B => t5-3b, t5-11B => t5-11b
9ad1ec42
fix export
59042e7f
Merge branch 'EncoderDecoderBeamSearch' of https://github.com/microso…
71bd39c0
update comments
56306319
Enable dump
c5687c9e
update sequence length, and no position for T5
691cd4e7
update decoder inputs
71aaba98
include header with directory
bc28320d
fix line_length>120 and spelling errors
664c75cc
make sure line_length <= 120
2eb4ba31
fix cpplint warnings
2d331d3a
include relative path
219479fe
Merge branch 'EncoderDecoderBeamSearch' of https://github.com/microso…
25397bf5
add --use_int32_inputs in convert t5 to onnx
6777f47d
update cuda device helper to use int32 inputs
237546f8
Fix lint warnings
9ae72530
Merge remote-tracking branch 'origin/master' into EncoderDecoderBeamS…
ea4963d7
Merge branch 'EncoderDecoderBeamSearch' of https://github.com/microso…
ae0e72dd
use constexpr for past input/output index
235f63d1
initial sequence length 1
3f180fe3
fix ORT_ENFORCE of hypothesis_buffer_offset_
fb5c5d7e
init sequence from decoder_input_ids in cpu
9b2c4d0b
Merge branch 'EncoderDecoderBeamSearch' of https://github.com/microso…
28b934e9
fix cuda error
dd1aee23
fix linux build
313a3b5e
add tests and default int32 inputs
ac6b9e63
Merge branch 'EncoderDecoderBeamSearch' of https://github.com/Microso…
c3beb847
add more tests; allow t5 in one step
29deedb0
update for lint warning
221a0522
tianleiwu
changed the title [WIP] Support T5 in BeamSearch operator Support T5 in BeamSearch operator 3 years ago
remove useless comment
05142ff1
tianleiwu
marked this pull request as ready for review 3 years ago
update comments; disable dump
d3cff625
add comments
13f113d9
wangyems
dismissed these changes
on 2022-06-09
address review feedback
84e4729d
tianleiwu
dismissed their stale review
via 84e4729d
3 years ago
wangyems
approved these changes
on 2022-06-10
tianleiwu
merged
def78a1b
into master 3 years ago
tianleiwu
deleted the EncoderDecoderBeamSearch branch 3 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub