onnxruntime
[EP ABI] Initial support for kernel-based EPs
#26206
Merged
Overview
Commits
79
Changes
View On GitHub

[EP ABI] Initial support for kernel-based EPs #26206

adrianlizarraga merged 79 commits into main from adrianl/ep-abi-kernel-based-eps
adrianlizarraga
adrianlizarraga Sketch API funcs
8c03c614
adrianlizarraga Merge branch 'main' into adrianl/ep-abi-kernel-based-eps
40d7866b
adrianlizarraga Implement more c apis
ec46ea59
adrianlizarraga OpKernel class for plugin EPs
e8532a9c
adrianlizarraga Initialize PluginExecutionProvider's kernel registry
246681ce
adrianlizarraga Move files to session
6b61b917
adrianlizarraga Add API to set kernel def I/O memory types
4a112fc4
adrianlizarraga Add C API to add type constraints to a kernel definition
0f870d0e
adrianlizarraga Start implementing MemcpyFromHost kernel in example EP
9be69234
adrianlizarraga Get kernel for MemcpyFromHost working for example plugin EP!
5df3fb56
adrianlizarraga Moved example plugin EP's kernel stuff to different file
5aade60f
adrianlizarraga Add separate utility to load OrtMLDataTypes
d159b385
adrianlizarraga Add MLDataTypes::GetTensorType()
81872338
adrianlizarraga Add C++ Ort::KernelDefBuilder to allow creation of macro
bf92f04d
adrianlizarraga Create macro for defining BuildKernelCreateInfo functions for each op
da14d656
adrianlizarraga Move kernels to separate directory/files
73ae3071
adrianlizarraga Use data transfer in MemcpyFromHost and MemcpyToHost
fb4a6a6c
adrianlizarraga Release OrtKernelCreateInfo instances if an error occurs
b8867d6f
adrianlizarraga Move typedef and add forward-declaration of OrtKernelImpl for gcc
de8be322
adrianlizarraga Merge branch 'main' into adrianl/ep-abi-kernel-based-eps
dc78ec30
adrianlizarraga adrianlizarraga requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 245 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2025-10-01
adrianlizarraga Apply suggestions from code review
8babb639
adrianlizarraga Simplify with OrtKernelRegistry
90bf5981
adrianlizarraga Pass custom state to kernel creation in plugin EP
9f955896
adrianlizarraga Clean up
90e4fc1a
adrianlizarraga adrianlizarraga requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 244 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2025-10-02
adrianlizarraga ExampleEp: cache kernel registry in factory so it can be reused by al…
5f52cdc8
adrianlizarraga Add C API to lookup a kernel from within OrtEp::GetCapability
9bfc2813
adrianlizarraga Disambiguate a compiled subgraph (of one node) from a registered kern…
60ea06c3
adrianlizarraga Add unit test for EpGraphSupportInfo_LookUpKernel()
33ffd8df
adrianlizarraga Add missing include needed for linux ci
31cdc827
adrianlizarraga Add KernelDef to C++ api and add basic getters
93b99e67
adrianlizarraga adrianlizarraga changed the title [EP ABI] [DRAFT] Support kernel-based EPs [EP ABI] [DRAFT] Initial support for kernel-based EPs 243 days ago
yuslepukhin
yuslepukhin commented on 2025-10-02
adrianlizarraga Add documentation comments
995e25b5
adrianlizarraga Remove incorrect comment
0f7145f3
adrianlizarraga
adrianlizarraga commented on 2025-10-03
adrianlizarraga
adrianlizarraga commented on 2025-10-03
adrianlizarraga
adrianlizarraga commented on 2025-10-03
adrianlizarraga adrianlizarraga changed the title [EP ABI] [DRAFT] Initial support for kernel-based EPs [EP ABI] Initial support for kernel-based EPs 243 days ago
adrianlizarraga
adrianlizarraga commented on 2025-10-03
adrianlizarraga adrianlizarraga requested a review from edgchen1 edgchen1 243 days ago
adrianlizarraga adrianlizarraga requested a review from skottmckay skottmckay 243 days ago
adrianlizarraga adrianlizarraga requested a review from chilo-ms chilo-ms 243 days ago
adrianlizarraga adrianlizarraga requested a review from fs-eire fs-eire 243 days ago
adrianlizarraga adrianlizarraga marked this pull request as ready for review 243 days ago
adrianlizarraga
adrianlizarraga commented on 2025-10-04
adrianlizarraga
adrianlizarraga commented on 2025-10-04
edgchen1
edgchen1 commented on 2025-10-04
edgchen1
edgchen1 commented on 2025-10-04
adrianlizarraga Add missing API_IMPL_BEGIN/END macro calls
f528f6f3
adrianlizarraga Merge branch 'main' into adrianl/ep-abi-kernel-based-eps
9fbf230a
edgchen1
edgchen1 commented on 2025-10-06
adrianlizarraga Merge main and fix conflicts
92d82d8c
adrianlizarraga Merge branch 'main' into adrianl/ep-abi-kernel-based-eps
48ebab34
adrianlizarraga Move static PluginExecutionProvider::Create to a method on the factor…
1d92b908
adrianlizarraga Fix null return value from calling the internal kernel lookup function
d6404dd1
adrianlizarraga Add assertion that file opened successfully
60ac6f24
adrianlizarraga Fix unused variables
f48d6f8a
adrianlizarraga Fix another unused variable
5da69e8b
adrianlizarraga Add new example EP that uses kernel registration
70b34341
adrianlizarraga lintrunner
faf4260e
adrianlizarraga Merge branch 'main' into adrianl/ep-abi-kernel-based-eps
3dfa5008
adrianlizarraga Remove memcpy kernels from example ep
692ec03d
adrianlizarraga Fix android compiler error due to unused field
38d433cf
adrianlizarraga Fix gsl linking for non-windows
fd20c294
adrianlizarraga Merge branch 'main' into adrianl/ep-abi-kernel-based-eps
6aa4b50f
adrianlizarraga Add unit test that uses kernel-based EP to run a model with Squeeze a…
198ab0d2
adrianlizarraga Copy new example ep .so to android test directory. Ensure unit tests …
ea91325b
adrianlizarraga Mark OrtEp::Compile() and OrtEp::ReleaseNodeComputeInfos() as optiona…
dcb6e068
adrianlizarraga Add C++ Ort::KernelRegistry class
caf1274d
adrianlizarraga Update include/onnxruntime/core/session/onnxruntime_cxx_api.h
d2d8f610
adrianlizarraga Clean up kernel registration code on the EP side
5771cc2f
adrianlizarraga Clean up
a43d7d69
adrianlizarraga adrianlizarraga requested a review from edgchen1 edgchen1 207 days ago
adrianlizarraga Add KernelBuilder aliasing API functions. Add a relu kernel to test it.
5aa4f75e
adrianlizarraga Edit test onnx model to properly test mutable alias (buffer reuse for…
2ff711d7
edgchen1
edgchen1 commented on 2025-11-08
adrianlizarraga
adrianlizarraga commented on 2025-11-08
adrianlizarraga Address review comments
d131945a
adrianlizarraga Forgot to change return Ort::Status{nullptr} to return nullptr
9d37ff89
adrianlizarraga adrianlizarraga requested a review from edgchen1 edgchen1 205 days ago
edgchen1
edgchen1 commented on 2025-11-10
adrianlizarraga Merge branch 'main' into adrianl/ep-abi-kernel-based-eps
635b2b59
adrianlizarraga Address review comments
a0b5fdda
adrianlizarraga Update lib name for files copied to Android testing dir
24bfd53e
adrianlizarraga Rename DLL in .def file
b0a0b847
edgchen1
edgchen1 commented on 2025-11-11
adrianlizarraga Address (great) review comments
874b54e0
adrianlizarraga Correct documentation regarding the meaning of -1 for the 'end_version'.
099e8f3a
adrianlizarraga Don't include unnecessary initial struct vals
248c3a3b
yuslepukhin
yuslepukhin commented on 2025-11-11
yuslepukhin
yuslepukhin commented on 2025-11-11
yuslepukhin
yuslepukhin commented on 2025-11-11
yuslepukhin
yuslepukhin commented on 2025-11-11
adrianlizarraga Split up parameters into two parallel arrays
96f9f70e
adrianlizarraga Merge branch 'main' into adrianl/ep-abi-kernel-based-eps
250c7aa7
adrianlizarraga Add checks and more unit tests for KernelDefBuilder_SetSinceVersion
7d5627bd
adrianlizarraga Decide to remove unused FuncManager parameter from the kernel creatio…
bb1fa0dc
edgchen1
edgchen1 commented on 2025-11-14
adrianlizarraga Merge branch 'main' into adrianl/ep-abi-kernel-based-eps
7b2b6e09
adrianlizarraga Address review comments: base kernel class, auto*, data_type utils no…
0913a943
adrianlizarraga Complete approach B
b28afb34
edgchen1
edgchen1 approved these changes on 2025-12-02
edgchen1
edgchen1 dismissed these changes on 2025-12-02
skottmckay
skottmckay commented on 2025-12-02
skottmckay
skottmckay commented on 2025-12-02
adrianlizarraga Review comments
d1ef6b05
adrianlizarraga adrianlizarraga dismissed their stale review via d1ef6b05 183 days ago
adrianlizarraga Remove noexcept from BaseKernel::DoCompute
6ba335fb
edgchen1
edgchen1 commented on 2025-12-03
adrianlizarraga Review comments
945d31ec
adrianlizarraga adrianlizarraga requested a review from skottmckay skottmckay 181 days ago
adrianlizarraga adrianlizarraga requested a review from edgchen1 edgchen1 181 days ago
edgchen1
edgchen1 commented on 2025-12-04
adrianlizarraga Update onnxruntime/core/session/plugin_ep/ep_plugin_provider_interfac…
9ebeacec
adrianlizarraga Update onnxruntime/test/autoep/library/example_plugin_ep_kernel_regis…
4b2f9f09
adrianlizarraga Review comments
568c6c0a
adrianlizarraga adrianlizarraga requested a review from edgchen1 edgchen1 180 days ago
edgchen1
edgchen1 approved these changes on 2025-12-05
adrianlizarraga adrianlizarraga merged db6d83b6 into main 179 days ago
adrianlizarraga adrianlizarraga deleted the adrianl/ep-abi-kernel-based-eps branch 179 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum