onnxruntime
Plugin EP data transfer and Stream support.
#25254
Merged
Overview
Commits
32
Changes
View On GitHub

Plugin EP data transfer and Stream support. #25254

skottmckay merged 32 commits into main from skottmckay/OrtSyncStream
skottmckay
skottmckay Initial pieces for Stream support.
84f06215
skottmckay skottmckay requested a review from adrianlizarraga adrianlizarraga 206 days ago
skottmckay skottmckay removed review request from adrianlizarraga adrianlizarraga 206 days ago
skottmckay skottmckay requested a review from edgchen1 edgchen1 206 days ago
skottmckay skottmckay requested a review from adrianlizarraga adrianlizarraga 206 days ago
skottmckay
skottmckay Fix build warning
8725d765
skottmckay Add ability to get OrtMemoryInfo for session inputs/outputs
d386a5fd
skottmckay Define _In_reads_opt_ on linux
6df4f97b
skottmckay Merge
566bdf3c
skottmckay Update CUDA EP with allocator, data transfer and stream implementations.
f68b472b
bil-ash
skottmckay Add test with data copy of inputs. Uses a shared allocator and CopyTe…
a8ae38bd
skottmckay CUDA OrtSyncStreamImpl works.
affc9256
skottmckay Merge
862d6c44
skottmckay Merge remote-tracking branch 'origin/main' into skottmckay/OrtSyncStream
1d60ee16
skottmckay Fix a couple of issues
860c692d
skottmckay Cleanups. Removed things not currently in use.
e35d8d7b
skottmckay skottmckay changed the title Initial pieces for plugin EP Stream support. Plugin EP DataCopy and Stream support. 199 days ago
skottmckay skottmckay marked this pull request as ready for review 199 days ago
github-actions
github-actions commented on 2025-07-09
skottmckay Minor refinements
9b3378fb
skottmckay
skottmckay commented on 2025-07-07
skottmckay Fix linux build errors
686632db
skottmckay Fix minimal build
c1ad6e61
skottmckay Fix x86 build
3b3217fa
github-actions
github-actions commented on 2025-07-09
skottmckay
skottmckay commented on 2025-07-09
skottmckay skottmckay changed the title Plugin EP DataCopy and Stream support. Plugin EP data transfer and Stream support. 199 days ago
skottmckay More CI fixes.
c1adcffe
skottmckay Allow for CUDA library to not be found.
34c07173
skottmckay Update example EP to be more testable.
6bbd4fdc
github-actions
github-actions commented on 2025-07-10
skottmckay Fix some tests
2b524d0b
skottmckay Auto-unregister EP in autoep unit test.
f75ac146
skottmckay Change tolerance for CIs. The values indicate the data was copied.
91e7d17c
skottmckay Add optional arg for OrtEp to OrtEpFactory.CreateAllocator. Matches C…
410faef6
skottmckay Merge remote-tracking branch 'origin/main' into skottmckay/OrtSyncStream
4924a7cc
skottmckay skottmckay added release:1.23.0
skottmckay Merge remote-tracking branch 'origin/main' into skottmckay/OrtSyncStream
43bc6f5b
skottmckay skottmckay requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 193 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2025-07-14
jywu-msft
jywu-msft commented on 2025-07-16
pgonegandla
pgonegandla commented on 2025-07-16
adrianlizarraga
adrianlizarraga commented on 2025-07-17
skottmckay Merge
02b6c966
skottmckay Address PR comments.
67f04524
gaugarg-nv
gaugarg-nv commented on 2025-07-07
skottmckay Fix Linux/Android build issue
55c83ab7
skottmckay Fix minimal and qnn builds
b8d965e2
skottmckay Fix x86 build
e40d961c
skottmckay Fix unused parameter warning.
33e807ba
skottmckay Merge remote-tracking branch 'origin/main' into skottmckay/OrtSyncStream
0914cdd2
adrianlizarraga
adrianlizarraga approved these changes on 2025-07-19
jywu-msft
jywu-msft approved these changes on 2025-07-19
skottmckay skottmckay merged 9d11ae2e into main 189 days ago
skottmckay skottmckay deleted the skottmckay/OrtSyncStream branch 189 days ago
snnn snnn removed release:1.23.0
snnn

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum