onnxruntime
Add BeamSearch operator for GPT-2 decoding
#9680
Merged
Overview
Commits
42
Changes
View On GitHub

Add BeamSearch operator for GPT-2 decoding #9680

tianleiwu merged 42 commits into master from tlwu/gpt_beam_search_op
tianleiwu
tianleiwu Add BeamSearch op schema
34f396fb
tianleiwu Add ONNX conversion for beams search
1fe45a25
tianleiwu tianleiwu marked this pull request as draft 4 years ago
tianleiwu remove attention_mask and change input order
e7a665c3
tianleiwu add option to run baseline
27bf8093
tianleiwu add check data type NULL
a6c402fe
tianleiwu applies VerifyNodeAndOpMatch to subgraph
147763c6
tianleiwu update input_ids shape
bd10853a
tianleiwu Add node name for Cast node
4ba5d001
viboga viboga requested a review from viboga viboga 4 years ago
tianleiwu expose API for topk
e343472c
tianleiwu parse parameters
1c2d9cd9
tianleiwu Add beam search scorer
820a53cd
viboga
viboga commented on 2021-11-17
viboga
viboga commented on 2021-11-17
tianleiwu output results
e1ae8485
tianleiwu fix typo
1f1ee1a5
tianleiwu use c++ template and format python
7c4fd9a9
tianleiwu fix build pipeline errors
09e2458c
tianleiwu symbolic shape infer of input onnx
afe4b129
tianleiwu output scores
2396c3b4
tianleiwu add kernel def hash
b444e704
tianleiwu Handle vocab_mask; move CheckSubgraph
bb032c24
tianleiwu undo insert_cast_transformer.cc and fusion_utils.py
fb275641
tianleiwu fix typo
cdb62bb3
tianleiwu Merge remote-tracking branch 'origin/master' into tlwu/gpt_beam_searc…
f32b5d18
tianleiwu fix merge
bca63fdf
tianleiwu update doc
3e0cb7f7
tianleiwu add repetition penalty
872408ca
tianleiwu refactoring: add GptSubgraph class
06dc72b2
tianleiwu move BeamSearchState from .h to .cc file
8bab52a5
tianleiwu adjust logits processor order
7db869c9
tianleiwu add batch generation example
b23540e0
tianleiwu fix repetition penalty for dup words in sequence
25f7605f
tianleiwu Add test
25751e7a
tianleiwu Add no repeat ngram processor
6a2427f3
tianleiwu refactoring: move logits processor to classes
5e42e69d
tianleiwu fix build warning
312d5486
tianleiwu show latency
3371cb45
tianleiwu use allocator in beam state
a63a473a
tianleiwu use allocator in sequences
08277874
tianleiwu Merge branch 'master' into tlwu/gpt_beam_search_op
5c23d3c2
tianleiwu tianleiwu changed the title [WIP] Add BeamSearch operator for GPT-2 decoding Add BeamSearch operator for GPT-2 decoding 4 years ago
tianleiwu fix build error
08bd1d77
tianleiwu Merge branch 'tlwu/gpt_beam_search_op' of https://github.com/microsof…
1987a2c0
tianleiwu tianleiwu marked this pull request as ready for review 4 years ago
tianleiwu tianleiwu requested a review from edgchen1 edgchen1 4 years ago
tianleiwu tianleiwu requested a review from guoyu-wang guoyu-wang 4 years ago
tianleiwu tianleiwu requested a review from skottmckay skottmckay 4 years ago
tianleiwu tianleiwu requested a review from YUNQIUGUO YUNQIUGUO 4 years ago
tianleiwu move next_positions to beam state
c7d456b5
viboga
viboga commented on 2021-12-13
viboga
viboga commented on 2021-12-13
viboga
viboga commented on 2021-12-13
viboga
viboga commented on 2021-12-13
viboga
viboga commented on 2021-12-13
viboga
viboga commented on 2021-12-13
viboga
viboga commented on 2021-12-13
viboga
viboga
viboga commented on 2021-12-14
viboga
viboga commented on 2021-12-14
tianleiwu tianleiwu requested a review from baijumeswani baijumeswani 4 years ago
tianleiwu tianleiwu requested a review from liqunfu liqunfu 4 years ago
tianleiwu tianleiwu requested a review from SherlockNoMad SherlockNoMad 4 years ago
tianleiwu tianleiwu requested a review from thiagocrepaldi thiagocrepaldi 4 years ago
tianleiwu tianleiwu requested a review from tlh20 tlh20 4 years ago
tianleiwu tianleiwu requested a review from xadupre xadupre 4 years ago
tianleiwu tianleiwu force pushed from ff978cc2 to c7d456b5 4 years ago
tianleiwu tianleiwu removed review request from liqunfu liqunfu 4 years ago
tianleiwu tianleiwu removed review request from thiagocrepaldi thiagocrepaldi 4 years ago
tianleiwu tianleiwu removed review request from SherlockNoMad SherlockNoMad 4 years ago
tianleiwu tianleiwu removed review request from baijumeswani baijumeswani 4 years ago
tianleiwu tianleiwu removed review request from xadupre xadupre 4 years ago
tianleiwu tianleiwu removed review request from tlh20 tlh20 4 years ago
tianleiwu Merge remote-tracking branch 'origin/master' into tlwu/gpt_beam_searc…
bc89d44e
viboga viboga requested a review from viboga viboga 4 years ago
viboga
viboga approved these changes on 2021-12-16
guoyu-wang
guoyu-wang approved these changes on 2021-12-17
tianleiwu tianleiwu merged ef36488d into master 4 years ago
tianleiwu tianleiwu deleted the tlwu/gpt_beam_search_op branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum