optimum
Add IOBinding support to ONNX Runtime module
#421
Merged
Overview
Commits
53
Changes
View On GitHub

Add IOBinding support to ONNX Runtime module #421

JingyaHuang merged 53 commits into main from add-ort-iobinding
JingyaHuang
JingyaHuang Create IOBinding helper and Type helper
7b058e59
JingyaHuang fix style
a82f2ab1
HuggingFaceDocBuilderDev
JingyaHuang Apply IOBinding helper to causallm model
9ff48be3
JingyaHuang remove useless
a0ae7290
JingyaHuang JingyaHuang requested a review from philschmid philschmid 3 years ago
JingyaHuang JingyaHuang requested a review from lewtun lewtun 3 years ago
michaelbenayoun
michaelbenayoun commented on 2022-10-14
JingyaHuang Update docstring
ee7afd5c
JingyaHuang Add use_io_binding args
c280fa2b
lewtun
lewtun commented on 2022-10-17
JingyaHuang Fix case
adfbc6a3
JingyaHuang Fix doctring
bef7f4df
JingyaHuang Fix docstring
dd7db8f5
JingyaHuang Fix case
cd06b9a1
JingyaHuang Improve class description
92ff5de5
JingyaHuang Improve class description
a4f70c5b
JingyaHuang Complete comment
ec600235
JingyaHuang Fix use_io_binding value define bug
da6fe5ae
JingyaHuang Fix typos
0729d0b3
JingyaHuang np to numpy
9446274e
JingyaHuang Replace asserts with error raise
80e9c1ab
JingyaHuang Add io binding return type
4ddfcdbc
JingyaHuang Add is_onnxruntime_training_available in utils
0c8813c8
JingyaHuang
JingyaHuang commented on 2022-10-17
JingyaHuang Apply io binding to encoders
a07b6a8c
JingyaHuang Also for custom tasks
f08479f5
JingyaHuang Improve use_io_binding args
8c7d82e2
philschmid
philschmid commented on 2022-10-18
JingyaHuang Apply io binding for seq2seq
e97769b6
JingyaHuang seq2seq io binding bug fix
a5e599bb
JingyaHuang nits
7dcaff86
JingyaHuang remove zip when outputs are fixed
78a5106d
JingyaHuang Check cupy availability
cd999d41
JingyaHuang Move io binding preparation to causal model
2ec100f8
JingyaHuang move io binding preparation for other ort models
369c4414
JingyaHuang Move io binding to ort seq2seq model
2424e335
JingyaHuang Bind output tensors directly for causal lm
39182344
JingyaHuang Remove useless in IO helper
c2e9d5d7
JingyaHuang Fix test name
a3ac26c9
JingyaHuang Direct binding for multi-choice/im-cls/custom
fffcccce
JingyaHuang JingyaHuang requested a review from lewtun lewtun 3 years ago
JingyaHuang JingyaHuang requested a review from philschmid philschmid 3 years ago
JingyaHuang Direct binding for all other ort models
b2187586
JingyaHuang Remove IO binding for ORTModelForCustomModels
6c38d460
JingyaHuang Remove unused import
c774f38b
JingyaHuang Merge main
ede2895a
JingyaHuang IO binding added for seq2seq model
5236a158
JingyaHuang JingyaHuang marked this pull request as ready for review 3 years ago
fxmarty
philschmid
philschmid commented on 2022-10-24
JingyaHuang modify for comments
9f5a2a3d
JingyaHuang Revert dependencies for anothet PR
fb1680d8
JingyaHuang Add IO binding tests for Encoder/Decoder
07f3248c
JingyaHuang Add config for passing seq2seq modeling tests
b90ae76a
JingyaHuang Improve seq2seq buffer size
aadd037e
JingyaHuang Add test for seq2seq
e98ee95e
philschmid
philschmid commented on 2022-10-26
JingyaHuang Add tests for generation
855bad5d
JingyaHuang
JingyaHuang commented on 2022-10-25
JingyaHuang
JingyaHuang Merge branch 'main' into add-ort-iobinding
56bf6c6e
JingyaHuang JingyaHuang requested a review from philschmid philschmid 3 years ago
regisss
regisss commented on 2022-10-26
JingyaHuang Fix doc
cc51dc66
JingyaHuang Add comments
095268b0
JingyaHuang Merge branch 'add-ort-iobinding' of https://github.com/huggingface/op…
479be02a
JingyaHuang Add warning for TensorRT
c0eea41d
JingyaHuang Merge main branch
a6021a67
fxmarty
fxmarty commented on 2022-10-28
philschmid
philschmid approved these changes on 2022-10-31
JingyaHuang Test: allclose -> equal
505ed8c4
JingyaHuang JingyaHuang merged 5dfb4981 into main 3 years ago
JingyaHuang JingyaHuang deleted the add-ort-iobinding branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum