onnxruntime
Prefix match in first iteration of beam search OP
#10231
Merged

Commits
  • Add BeamSearch op schema
    tianleiwu committed 4 years ago
  • Add ONNX conversion for beams search
    tianleiwu committed 4 years ago
  • remove attention_mask and change input order
    tianleiwu committed 4 years ago
  • add option to run baseline
    tianleiwu committed 4 years ago
  • add check data type NULL
    tianleiwu committed 4 years ago
  • applies VerifyNodeAndOpMatch to subgraph
    tianleiwu committed 4 years ago
  • update input_ids shape
    tianleiwu committed 4 years ago
  • Add node name for Cast node
    tianleiwu committed 4 years ago
  • expose API for topk
    tianleiwu committed 4 years ago
  • parse parameters
    tianleiwu committed 4 years ago
  • Add beam search scorer
    tianleiwu committed 4 years ago
  • Merge remote-tracking branch 'origin/master' into tlwu/gpt_beam_search_op
    viboga committed 4 years ago
  • output results
    tianleiwu committed 4 years ago
  • fix typo
    tianleiwu committed 4 years ago
  • use c++ template and format python
    tianleiwu committed 4 years ago
  • Merge branch 'tlwu/gpt_beam_search_op' of https://github.com/Microsoft/onnxruntime into tlwu/gpt_beam_search_op
    viboga committed 4 years ago
  • Merge remote-tracking branch 'origin/master' into tlwu/gpt_beam_search_op
    viboga committed 4 years ago
  • fix build pipeline errors
    tianleiwu committed 4 years ago
  • symbolic shape infer of input onnx
    tianleiwu committed 4 years ago
  • output scores
    tianleiwu committed 4 years ago
  • add kernel def hash
    tianleiwu committed 4 years ago
  • Handle vocab_mask; move CheckSubgraph
    tianleiwu committed 4 years ago
  • undo insert_cast_transformer.cc and fusion_utils.py
    tianleiwu committed 4 years ago
  • fix typo
    tianleiwu committed 4 years ago
  • Merge remote-tracking branch 'origin/master' into tlwu/gpt_beam_search_op
    tianleiwu committed 4 years ago
  • fix merge
    tianleiwu committed 4 years ago
  • update doc
    tianleiwu committed 4 years ago
  • add repetition penalty
    tianleiwu committed 4 years ago
  • refactoring: add GptSubgraph class
    tianleiwu committed 4 years ago
  • move BeamSearchState from .h to .cc file
    tianleiwu committed 4 years ago
  • adjust logits processor order
    tianleiwu committed 4 years ago
  • add batch generation example
    tianleiwu committed 4 years ago
  • fix repetition penalty for dup words in sequence
    tianleiwu committed 4 years ago
  • Add test
    tianleiwu committed 4 years ago
  • Add no repeat ngram processor
    tianleiwu committed 4 years ago
  • refactoring: move logits processor to classes
    tianleiwu committed 4 years ago
  • fix build warning
    tianleiwu committed 4 years ago
  • show latency
    tianleiwu committed 4 years ago
  • use allocator in beam state
    tianleiwu committed 4 years ago
  • use allocator in sequences
    tianleiwu committed 4 years ago
  • Merge branch 'master' into tlwu/gpt_beam_search_op
    tianleiwu committed 4 years ago
  • fix build error
    tianleiwu committed 4 years ago
  • Merge branch 'tlwu/gpt_beam_search_op' of https://github.com/microsoft/onnxruntime into tlwu/gpt_beam_search_op
    tianleiwu committed 4 years ago
  • move next_positions to beam state
    tianleiwu committed 4 years ago
  • Merge branch 'tlwu/gpt_beam_search_op' of https://github.com/Microsoft/onnxruntime into tlwu/gpt_beam_search_op
    viboga committed 4 years ago
  • Merge remote-tracking branch 'origin/master' into tlwu/gpt_beam_search_op
    viboga committed 4 years ago
  • Changes for prefix matching
    viboga committed 4 years ago
  • merged with master
    viboga committed 4 years ago
  • removing debugs
    viboga committed 4 years ago
  • removing more debugs
    viboga committed 4 years ago
  • clean up
    viboga committed 4 years ago
  • clean up
    viboga committed 4 years ago
  • cpu doc updated
    viboga committed 4 years ago
  • Updated docs
    viboga committed 4 years ago
  • updated prefix_vocab_mask dimension in convert script
    viboga committed 4 years ago
  • changes to support bxs prefix_vocab_mask in beamsearchop kernel
    viboga committed 4 years ago
  • Merge remote-tracking branch 'origin/master' into Vish/changes_for_prefix_matching
    viboga committed 4 years ago
  • doc update
    viboga committed 4 years ago
  • OperatorKernels.md updated
    viboga committed 4 years ago
  • matching docs from artifacts
    viboga committed 4 years ago
  • minor change in logits processor
    viboga committed 4 years ago
  • Merge remote-tracking branch 'origin/master' into Vish/changes_for_prefix_matching
    viboga committed 4 years ago
  • Addressing comments
    viboga committed 4 years ago
  • Updated the prefix vocab mask usage properly
    viboga committed 4 years ago
Loading