PR #9978 Support CUDA Graph

Support CUDA Graph #9978

hariharans29 merged 20 commits into microsoft:master from feihugis:cuda_graph

pranavsharma assigned

hariharans29 4 years ago

hariharans29 commented on 2022-01-27

feihugis force pushed from b463781e to 753741fe 4 years ago

hariharans29 commented on 2022-01-31

feihugis force pushed from a133fc70 to e6a41946 4 years ago

feihugis force pushed from e6a41946 to 002559b4 4 years ago

feihugis force pushed from 002559b4 to fdaebfa7 4 years ago

hariharans29 commented on 2022-02-02

feihugis force pushed from fdaebfa7 to 6495dfa2 4 years ago

feihugis force pushed from 6495dfa2 to 1e1c41c5 4 years ago

feihugis force pushed from 1e1c41c5 to b62cca52 4 years ago

feihugis force pushed from b62cca52 to 2f991ea8 4 years ago

feihugis force pushed from 2f991ea8 to fe96035d 4 years ago

feihugis force pushed from fe96035d to 1f52aeb1 4 years ago

hariharans29 commented on 2022-02-07

hariharans29 requested a review from

pranavsharma 4 years ago

hariharans29 requested a review from

skottmckay 4 years ago

hariharans29 commented on 2022-02-07

hariharans29 commented on 2022-02-08

hariharans29 commented on 2022-02-09

feihugis force pushed from 77822ddc to e2846f76 4 years ago

feihugis force pushed from 6abce8c7 to 3923f086 4 years ago

hariharans29 commented on 2022-02-11

pranavsharma commented on 2022-02-18

pranavsharma commented on 2022-02-19

hariharans29 commented on 2022-02-21

feihugis force pushed from 0808cd55 to d7c8aae7 4 years ago

feihugis force pushed from d7c8aae7 to c00a8fac 4 years ago

hariharans29 commented on 2022-02-23

hariharans29 commented on 2022-02-28

feihugis force pushed from cde6091e to 7eb2dbd9 4 years ago

Support CUDA Graph

6645bcb8

Update the APIs

535464ab

Address some comments

5de03e45

Reflect the latest API changes

b819c444

Address some comments

0ce98f0b

Support warmup runs before capturing cuda graph and solve the sync re…

377cce9f

Rename python test file and minor fix

7990c9ba

Remove some unncessary comments, superfluous syncs, and warm up runs…

e484ca62

Add a CApiTest for run cuda graph

297b27c8

Fix build failures

d9894a74

Change the default run to be 1 and avoid using the word warmup

ade7af24

Change static var to private member var and a minor format fixing

8e3fcc9b

Run cuda graph with multiple threads

9edf6c6e

Address comments

21e5192a

Remove a file added by mistake

87f10752

Update doc for update_inplace

9a7ab55c

Enhance the support of CUDA graph with multi threads

832cf770

Add CachedExecutionProviderForGraphReplay and more comments

af0bc102

Rollback the support of cuda graph with multi threads

5ee89bba

feihugis force pushed from 7eb2dbd9 to 5ee89bba 4 years ago

hariharans29 commented on 2022-03-04

pranavsharma commented on 2022-03-04

Address the comments

a14f819b

feihugis force pushed from 4a974e91 to a14f819b 4 years ago

pranavsharma commented on 2022-03-04

hariharans29 approved these changes on 2022-03-07

hariharans29 merged 60acfd3d into master 4 years ago

Reviewers

hariharans29

pranavsharma

skottmckay

Assignees

hariharans29

Labels

None yet

Milestone

No milestone

onnxruntime Support CUDA Graph #9978 Merged

Support CUDA Graph #9978

onnxruntime
Support CUDA Graph
#9978

Merged