onnxruntime
[EP ABI] Add OrtKernelInfo APIs for kernel-based plugin EPs
#26803
Merged
Merged
[EP ABI] Add OrtKernelInfo APIs for kernel-based plugin EPs #26803
adrianlizarraga
merged
53 commits into
main
from
adrianl/KernelPluginEp_KernelInfoApis
[EP ABI] Add weight pre-packing support to kernel-based plugin EPs
4f3d0042
Add comment about sharing of prepacked weights (cpu ep only)
e9540216
Update Mul kernel to pre-pack input b
fb2998b6
Apply suggestions from code review
5e64f79c
Add comments regarding prepack allocator lifetime
9b1c6a20
Merge branch 'adrianl/plugin-ep-kernel-prepack' of github.com:microso…
c638a1a0
Added support for sharing pre-packed weights for cpu-accessible alloc…
717ed4ac
Define what should happen if OrtKernelImpl::SetSharedPrePackedWeight(…
bd8f6f04
Add some missing OrtKernelInfo APIs for plugin EPs
5c94ec47
adrianlizarraga
commented
on 2025-12-15
Merge branch 'main' into adrianl/plugin-ep-kernel-prepack
fc1fd161
Clean up some exception handling
8b3f56c6
Refactor example kernel classes (no inheritance)
23503a18
Merge branch 'main' into adrianl/plugin-ep-kernel-prepack
7f37ffbd
Correct use of output param
26eca56c
Add more edge-case handling for PrePack() call
7af257b3
API version checks
515062e9
Use correct SAL annotation for array parameters
347ce4f4
Clean up some includes
906187d3
Merge branch 'main' into adrianl/KernelPluginEp_KernelInfoApis
56074f61
Update onnxruntime/core/session/plugin_ep/ep_kernel_registration.cc
1611fc38
Rename ExecuteIfCustomOpsApiEnabled to ExecuteifKernelApiEnabled
cb75d5a4
Remove OrtAllocator parameter from SharedPrePackedWeightCache_StoreWe…
30ca590e
Clarify what happens when SharedPrePackedWeightCache_StoreWeightData …
a5342b92
Merge branch 'main' into adrianl/KernelPluginEp_KernelInfoApis
c42d7ac6
Move some kernel info apis to OrtApi; Fix unrelated memory leak for K…
33233305
Merge branch 'main' into adrianl/plugin-ep-kernel-prepack
51bc7319
Review comments
edf3f2c2
C++ API
e94c0aab
Improve doc for c++ api convenience class
c8eb3c90
Add buffer_sizes as a parameter to OrtKernelImpl::SetSharedWeightData
98e3d132
Add comment to implementation of OrtKernelImpl::SetSharedPrePackedWeight
c61ae41f
Do not prescribe what the kernel impl should return for a situation t…
02d75d2e
Update include/onnxruntime/core/session/onnxruntime_ep_c_api.h
0a84eda6
Adjust comments
5f80f9d3
Tweak comment again
c60472d3
Merge main and fix conflicts
12b8394f
Update example kernel EP to get the OrtEp from OrtKernelInfo and add …
52453f2e
Address copilot review comments
79eadd85
Address copilot review comment: update error message when APIs for Or…
1dc98b2b
Add comments to clarify ownership scenarios
441c9e25
Merge branch 'adrianl/plugin-ep-kernel-prepack' into adrianl/KernelPl…
5cf96000
Base automatically changed from
adrianl/plugin-ep-kernel-prepack
to
main
217 days ago
Merge main and fix conflicts
ec0183e0
Add support for Add kernel to test kernel-based EP. This used as moti…
7e892619
Rename variable from 'mul_kernel' to 'binary_op_kernel'
1ddc9fb1
Address review comments and fix compiler warnings on Linux
9e6b06e4
Move KernelContext_GetAllocator memory leak fix to a different PR
1d496a29
Simplify binary op type check
6378bf26
fs-eire
dismissed these changes
on 2026-01-04
Merge branch 'main' into adrianl/KernelPluginEp_KernelInfoApis
eadc0290
Review comments + add new API to get op domain
cad57e7c
Check for NULL size arg in API call. Update comment
4fb2be94
Update SAL annotations for older KernelInfo_* API functions
ebe58ed6
Update example BinaryOp class to support Sub instead of Add
3968ec38
Update comment for KernelInfo_GetNodeName
df45a2f4
copilot-pull-request-reviewer
commented
on 2026-01-06
edgchen1
approved these changes
on 2026-01-06
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub