PR #13427 Custom Op runtime wrapper

Basic KernelInfo APIs

4d191319

Add KernelIOInfo and ConstTypeInfo to C++ API header.

b7237d2e

Add APIs to get config entries from SessionOptions

cde7f01c

Pass output session configs by reference

d3961bbc

Update SessionOptions C++ APIs (Add RegisterCustomOp, Add getters for…

6728278c

Merge main and fix conflicts

c8663eaa

Add C++ helper to build custom op config key

c79597cb

adrianlizarraga commented on 2022-10-25

adrianlizarraga requested a review from

yuslepukhin 3 years ago

adrianlizarraga requested a review from

pranavsharma 3 years ago

adrianlizarraga requested a review from

jywu-mysoft 3 years ago

Add stub _Out_writes_z_ SAL annotation

fa54d445

adrianlizarraga commented on 2022-10-25

add this->p_

4e24496f

pranavsharma commented on 2022-10-25

Merge main and fix conflicts

f3cf0e6b

Add test for custom op that has variadic inputs and outputs

61a68377

Create helper function to add test inputs

0027c23f

Clean up test

7f2f1e67

yuslepukhin commented on 2022-11-07

Port example

18cb752a

Test end-to-end example

b6998cad

Merge main

61b5df24

ONly run end-to-end example test when OpenVINO is enabled

2afdef5f

Fix signed/unsigned comparison in test

e44035ec

Refactor KernelInfo I/O API to be more like the SessionGetInput*() APIs.

eb66f01d

Merge latest main

272c2c24

Added more documentation. Reverted Ort::UnownedSessionOptions. Added …

bec8da49

adrianlizarraga commented on 2022-11-21

adrianlizarraga commented on 2022-11-22

yuslepukhin commented on 2022-11-22

Add Log public API.

87e7439d

Merge latest main updates

82d0ed7b

Add script to create a wrapper ONNX model for a custom op that wraps …

3994b665

yuslepukhin commented on 2022-12-01

Fix python script warnings

b358003b

Add check for case without node attributes

58033719

Merge latest main

3962c095

Support dynamic shape labels

f6f1ff2c

Make data attributes a uint8 tensor

1ee2f00b

Fix pyright errors due to change in type annotations

2ad6b7ec

More python lint fixes

60bafc5c

Merge latest main commits

20dce96b

yuslepukhin commented on 2022-12-06

Make public Log API noexcept

4042c430

yuslepukhin commented on 2022-12-07

yuslepukhin commented on 2022-12-08

Public API to get tensor attribute

d3e088e0

Elimiate copying of outputs from OpenVINO to ORT memory

c040f023

Do not use ORT_TRY macros in external example code

77945494

Convert Ort::Value into an ov::Tensor more generically

81219a96

Clean up OpenVINO custom op: delete copy constructors, add comment, m…

c7137cbe

Create CustomOpLibrary class in public C++ API

a337b84f

Pass custom op configs when call Register()

2af1bffb

Don't store session options as a member in custom op class

c909a417

Use std::string::data() instead of &[0]

7535b171

Merge latest main commits

1d62cb22

Add improvements/tests for variadic custom ops

ac29269f

Merge latest commits from main

42f69063

Use &out[0] instead of out.data() for std::string data access due to …

065e3dcc

Add Ort::CustomOpConfigs class for easier configuration of custom ops

e9e8795c

Merge latest commits from main

933568e7

Add new API to register custom op libs (handles releasing library han…

34a1c801

adrianlizarraga commented on 2022-12-21

yuslepukhin commented on 2022-12-21

Store custom op library handles in onnxruntime::SessionOptions

43bf3c11

adrianlizarraga commented on 2022-12-22

Merge latest commits from main

e03b74b0

Use a library handles class

5ec124e9

yuslepukhin commented on 2022-12-23

Merge latest main commits

2868b232

Address review comments for LibraryHandles class

472abc2e

Update documentation comments for Ort::CustomOpConfigs class

0ba31588

yuslepukhin commented on 2022-12-27

Merge latest commits from main

07d8cf3b

Rework custom op library handling

418d0487

Shorten cmake lines

4614ced1

Use dllexport instead of .def file for openvino custom op wrapper lib

12c5d2d4

Wrap long cmake line

b72f9061

Merge latest commits from main and update custom op example build

04ddd748

Clean up cmake for custom op example. Update doc on C API that return…

4e77f209

pranavsharma commented on 2023-01-06

Rename OrtApi::Log to OrtApi::OrtLog. Clean up SAL annotations. Clean…

166ddaa8

Merge latest commits from main

18f7c2c1

pranavsharma commented on 2023-01-06

pranavsharma dismissed these changes on 2023-01-06

Add usage motivation for OrtApi::OrtLog

98e254a8

adrianlizarraga dismissed their stale review via 98e254a8 3 years ago

adrianlizarraga marked this pull request as ready for review 3 years ago

pranavsharma dismissed these changes on 2023-01-07

adrianlizarraga assigned

adrianlizarraga 3 years ago

adrianlizarraga added release:1.14

Merge latest commits from main

e2d8eed9

Add logging APIs for OrtKernelContext

3098cd09

adrianlizarraga dismissed their stale review via 3098cd09 3 years ago

Fix indentation

b121138f

Add Env logging C APIs

d249d8f7

Merge latest commits from main

c571cd6c

Edit Env log API documentation

ef850228

Rename OrtKernelContext log api

8b62ebd5

Remove unused config entry key

ad8a098c

Add newline to onnxruntime_session_options_config_keys.h

2be4ba90

adrianlizarraga commented on 2023-01-13

pranavsharma commented on 2023-01-13

Remove new logging APIs

78133558

Merge latest commits from main

f80257a2

Merge latest commits from main

80bd7c1b

Merge latest commits from main

a390aa12

Merge latest commits from main

4ceca4a1

cbourjau commented on 2023-01-17

Merge latest commits from main

3a56af95

Add subheading for custom op APIs

fa94441f

Added custom op subheading to other C APIs

66e41157

pranavsharma approved these changes on 2023-01-17

adrianlizarraga merged de17d53c into main 3 years ago

adrianlizarraga deleted the adrianl/custom-op-runtime-wrapper branch 3 years ago

faxu removed release:1.14

onnxruntime
Custom Op runtime wrapper
#13427

Merged

Custom Op runtime wrapper #13427

onnxruntime Custom Op runtime wrapper #13427 Merged

Custom Op runtime wrapper #13427

onnxruntime
Custom Op runtime wrapper
#13427

Merged