onnxruntime
Prefix match in first iteration of beam search OP
#10231
Merged
Overview
Commits
64
Changes
View On GitHub

Prefix match in first iteration of beam search OP #10231

viboga merged 64 commits into master from Vish/changes_for_prefix_matching
viboga
tianleiwu Add BeamSearch op schema
34f396fb
tianleiwu Add ONNX conversion for beams search
1fe45a25
tianleiwu remove attention_mask and change input order
e7a665c3
tianleiwu add option to run baseline
27bf8093
tianleiwu add check data type NULL
a6c402fe
tianleiwu applies VerifyNodeAndOpMatch to subgraph
147763c6
tianleiwu update input_ids shape
bd10853a
tianleiwu Add node name for Cast node
4ba5d001
tianleiwu expose API for topk
e343472c
tianleiwu parse parameters
1c2d9cd9
tianleiwu Add beam search scorer
820a53cd
viboga Merge remote-tracking branch 'origin/master' into tlwu/gpt_beam_searc…
e1076fe7
tianleiwu output results
e1ae8485
tianleiwu fix typo
1f1ee1a5
tianleiwu use c++ template and format python
7c4fd9a9
viboga Merge branch 'tlwu/gpt_beam_search_op' of https://github.com/Microsof…
eedb1afd
viboga Merge remote-tracking branch 'origin/master' into tlwu/gpt_beam_searc…
e6c3c29e
tianleiwu fix build pipeline errors
09e2458c
tianleiwu symbolic shape infer of input onnx
afe4b129
tianleiwu output scores
2396c3b4
tianleiwu add kernel def hash
b444e704
tianleiwu Handle vocab_mask; move CheckSubgraph
bb032c24
tianleiwu undo insert_cast_transformer.cc and fusion_utils.py
fb275641
tianleiwu fix typo
cdb62bb3
tianleiwu Merge remote-tracking branch 'origin/master' into tlwu/gpt_beam_searc…
f32b5d18
tianleiwu fix merge
bca63fdf
tianleiwu update doc
3e0cb7f7
tianleiwu add repetition penalty
872408ca
tianleiwu refactoring: add GptSubgraph class
06dc72b2
tianleiwu move BeamSearchState from .h to .cc file
8bab52a5
tianleiwu adjust logits processor order
7db869c9
tianleiwu add batch generation example
b23540e0
tianleiwu fix repetition penalty for dup words in sequence
25f7605f
tianleiwu Add test
25751e7a
tianleiwu Add no repeat ngram processor
6a2427f3
tianleiwu refactoring: move logits processor to classes
5e42e69d
tianleiwu fix build warning
312d5486
tianleiwu show latency
3371cb45
tianleiwu use allocator in beam state
a63a473a
tianleiwu use allocator in sequences
08277874
tianleiwu Merge branch 'master' into tlwu/gpt_beam_search_op
5c23d3c2
tianleiwu fix build error
08bd1d77
tianleiwu Merge branch 'tlwu/gpt_beam_search_op' of https://github.com/microsof…
1987a2c0
tianleiwu move next_positions to beam state
c7d456b5
viboga Merge branch 'tlwu/gpt_beam_search_op' of https://github.com/Microsof…
b6d1ea0d
viboga Merge remote-tracking branch 'origin/master' into tlwu/gpt_beam_searc…
b7b875ed
viboga Changes for prefix matching
d676e7b9
viboga viboga requested a review from edgchen1 edgchen1 4 years ago
viboga viboga requested a review from guoyu-wang guoyu-wang 4 years ago
viboga viboga requested a review from skottmckay skottmckay 4 years ago
viboga viboga requested a review from YUNQIUGUO YUNQIUGUO 4 years ago
viboga viboga marked this pull request as draft 4 years ago
viboga merged with master
9efc9812
viboga removing debugs
b8adc8d9
viboga
viboga commented on 2022-01-10
viboga removing more debugs
5fcac568
tianleiwu
viboga clean up
70154708
viboga clean up
7111387b
viboga viboga removed review request from edgchen1 edgchen1 4 years ago
viboga cpu doc updated
aa8d4c2b
viboga Updated docs
f1c449d6
viboga viboga removed review request from guoyu-wang guoyu-wang 4 years ago
viboga viboga removed review request from skottmckay skottmckay 4 years ago
viboga viboga removed review request from YUNQIUGUO YUNQIUGUO 4 years ago
viboga viboga requested a review from tianleiwu tianleiwu 4 years ago
viboga
viboga viboga marked this pull request as ready for review 4 years ago
tianleiwu
edgchen1
azure-pipelines
viboga
tianleiwu
tianleiwu commented on 2022-01-18
tianleiwu
tianleiwu commented on 2022-01-18
tianleiwu
tianleiwu commented on 2022-01-18
tianleiwu
tianleiwu commented on 2022-01-18
tianleiwu
tianleiwu commented on 2022-01-18
tianleiwu
viboga updated prefix_vocab_mask dimension in convert script
eebf728e
viboga changes to support bxs prefix_vocab_mask in beamsearchop kernel
07a9a3b0
viboga Merge remote-tracking branch 'origin/master' into Vish/changes_for_pr…
adbaace3
viboga doc update
3a9544c9
viboga OperatorKernels.md updated
a312aa4d
viboga matching docs from artifacts
c7d08dc6
viboga minor change in logits processor
b34ae917
viboga viboga requested a review from tianleiwu tianleiwu 4 years ago
tianleiwu
tianleiwu commented on 2022-01-28
tianleiwu
tianleiwu commented on 2022-01-28
viboga Merge remote-tracking branch 'origin/master' into Vish/changes_for_pr…
5f8ea74c
tianleiwu
tianleiwu commented on 2022-01-31
viboga Addressing comments
85a2ae3a
viboga Updated the prefix vocab mask usage properly
3db10798
tianleiwu
tianleiwu approved these changes on 2022-02-01
viboga viboga requested a review from tianleiwu tianleiwu 4 years ago
viboga viboga merged ad9d2e2e into master 4 years ago
viboga viboga deleted the Vish/changes_for_prefix_matching branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum