onnxruntime
[Plugin EP] Port graph capture/replay APIs
#27958
Merged
Overview
Commits
27
Changes
View On GitHub

[Plugin EP] Port graph capture/replay APIs #27958

tianleiwu merged 27 commits into main from adrianl/PluginEp_CudaGraphCaptureReplay
adrianlizarraga
adrianlizarraga First incorrect draft impl
54fe58c5
adrianlizarraga Add IExecutionProvider::GetGraphCaptureNodeAssignmentPolicy() to remo…
b25bb093
adrianlizarraga Minor update to docs. Stills need improvement
3146b859
adrianlizarraga Add onnxruntime:: namespace qualifier for DML use of enum
023c0c0f
adrianlizarraga Merge branch 'main' into adrianl/PluginEp_CudaGraphCaptureReplay
bd71d7da
adrianlizarraga Implement new graph capture/replay C APIs in webgpu's OrtEp implement…
857f0b44
adrianlizarraga Add stubs with todos to cuda's plugin EP
0741b283
adrianlizarraga Use only one enum for the graph capture node assignment policy
f08d05b5
adrianlizarraga Update C doc comments
211bb7e0
adrianlizarraga First attempt at a webgpu plugin EP test that uses graph capture
91fb9650
adrianlizarraga
adrianlizarraga commented on 2026-04-04
adrianlizarraga adrianlizarraga requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 131 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-04
adrianlizarraga Add ifdef guards for webgpu plugin EP test
c38ba6c2
adrianlizarraga Review comments: Update NvTensorRTRTX EP to return false from IExecut…
61b8ff66
adrianlizarraga adrianlizarraga requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 129 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-06
adrianlizarraga Add InferenceSession::RunImpl() that takes in the recursive run depth
977dea11
adrianlizarraga Ensure at least one compute node is assigned to the graph capturing EP
8645b8dc
adrianlizarraga Add ORT_ENFORCE
b1582993
adrianlizarraga Merge branch 'main' into adrianl/PluginEp_CudaGraphCaptureReplay
0bc9cdcd
adrianlizarraga adrianlizarraga requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 128 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-06
adrianlizarraga Fix graph capture/replay test for the webgpu plugin EP (runs locally)
e289ae2a
adrianlizarraga CXX API: add Ort::Env::CopyTensor() to copy only one tensor
ff096258
adrianlizarraga adrianlizarraga requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 128 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-06
adrianlizarraga Update test EP registration to use correct ep lib name for various pl…
0718dae9
adrianlizarraga Update docs regarding the max number of attempts to call IsGraphCaptured
156a3cc0
adrianlizarraga adrianlizarraga requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 128 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-07
adrianlizarraga Merge branch 'main' into adrianl/PluginEp_CudaGraphCaptureReplay
a7e491e2
adrianlizarraga Adjust test ifdef for webgpu EP test that is not really the plugin EP…
20598862
adrianlizarraga Address doc comments
9205f225
adrianlizarraga Check that OrtEp::IsGraphCaptured and OrtEp::ReplayGraph are implemen…
5694f6c1
adrianlizarraga adrianlizarraga requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 125 days ago
adrianlizarraga adrianlizarraga changed the title [DRAFT] [Plugin EP] Port graph capture/replay APIs [Plugin EP] Port graph capture/replay APIs 125 days ago
adrianlizarraga adrianlizarraga marked this pull request as ready for review 125 days ago
adrianlizarraga adrianlizarraga requested a review from edgchen1 edgchen1 125 days ago
adrianlizarraga adrianlizarraga requested a review from tianleiwu tianleiwu 125 days ago
adrianlizarraga adrianlizarraga requested a review from yuslepukhin yuslepukhin 125 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-09
adrianlizarraga Address comments
cb66889d
adrianlizarraga adrianlizarraga requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 125 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-09
adrianlizarraga Sync IO binding inputs in test
91851acb
adrianlizarraga Improved documentation for graph annotation ID
ff929f39
adrianlizarraga adrianlizarraga requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 125 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-09
adrianlizarraga
adrianlizarraga commented on 2026-04-09
adrianlizarraga
adrianlizarraga commented on 2026-04-09
tianleiwu
tianleiwu commented on 2026-04-09
tianleiwu
tianleiwu approved these changes on 2026-04-09
tianleiwu tianleiwu merged 7afe4c25 into main 125 days ago
tianleiwu tianleiwu deleted the adrianl/PluginEp_CudaGraphCaptureReplay branch 125 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum