onnxruntime
Add CUDA Graph support for the CUDA plugin EP
#28002
Merged
Overview
Commits
13
Changes
View On GitHub

Add CUDA Graph support for the CUDA plugin EP #28002

tianleiwu merged 13 commits into main from tlwu/20260407/cuda_plugin_cuda_graph
tianleiwu
tianleiwu design of cuda graph for cuda plugin
908bab46
tianleiwu tianleiwu marked this pull request as draft 57 days ago
tianleiwu Merge main
1b81758a
tianleiwu cuda graph for cuda plugin
904af459
tianleiwu update doc and comments
5c1c4ded
tianleiwu Add test of cuda graph on second device
0923cb89
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 56 days ago
tianleiwu tianleiwu requested a review from yuslepukhin yuslepukhin 56 days ago
tianleiwu tianleiwu requested a review from edgchen1 edgchen1 56 days ago
tianleiwu tianleiwu requested a review from adrianlizarraga adrianlizarraga 56 days ago
tianleiwu tianleiwu marked this pull request as ready for review 56 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-09
tianleiwu handle "operation not supported" by MIG
6a49c7db
tianleiwu review feedback
c1c8532e
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 55 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-09
tianleiwu Thread-affine stream collection pool
484ff321
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 55 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-09
tianleiwu harden IsGraphCaptureEnabled
28f34f49
tianleiwu Merge remote-tracking branch 'origin/main' into tlwu/20260407/cuda_pl…
ca5e1c74
tianleiwu cudaGetDevice in kernel compute
a418b162
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 55 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-10
tianleiwu g_is_thread_capturing_cuda_graph
daa962d1
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 55 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-10
adrianlizarraga
adrianlizarraga commented on 2026-04-10
tianleiwu feedback
b03f3830
tianleiwu tianleiwu changed the title Cuda graph for cuda plugin ep Add CUDA Graph support for the CUDA plugin EP 55 days ago
adrianlizarraga
adrianlizarraga approved these changes on 2026-04-10
tianleiwu tianleiwu enabled auto-merge (squash) 54 days ago
tianleiwu tianleiwu merged 58a87dc1 into main 54 days ago
tianleiwu tianleiwu deleted the tlwu/20260407/cuda_plugin_cuda_graph branch 54 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum