onnxruntime
Regarding copy inputs before inference, flush the stream which copies the input only if the input is consumed by the ops from different streams
#19970

Merged

Regarding copy inputs before inference, flush the stream which copies the input only if the input is consumed by the ops from different streams #19970

jslhcl merged 7 commits into main from leca/flushCopiedInputOnlyIfConsumedByMultipleStreamOps

draft commit

d9b2be83

initialize MLValueCopyInfo.consumed_by_ops_from_different_stream and …

f5541c43

Merge branch 'main' of https://github.com/microsoft/onnxruntime into …

b06acac7

jslhcl changed the title ~~draft commit~~ Regarding copy inputs before inference, flush the stream which copies the input only if the input is consumed by the ops from different streams 2 years ago

jslhcl requested a review from

souptc 2 years ago

specify copied stream

12218a42

fix Linux build

47992b16

null reference check for device_stream_collection

463d9ea1

Merge branch 'leca/flushCopiedInputOnlyIfConsumedByMultipleStreamOps'…

3970ab73

jslhcl marked this pull request as ready for review 2 years ago

souptc approved these changes on 2024-03-25

jslhcl merged 793a8882 into main 2 years ago

jslhcl deleted the leca/flushCopiedInputOnlyIfConsumedByMultipleStreamOps branch 2 years ago

Reviewers

souptc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

onnxruntime Regarding copy inputs before inference, flush the stream which copies the input only if the input is consumed by the ops from different streams #19970 Merged

Regarding copy inputs before inference, flush the stream which copies the input only if the input is consumed by the ops from different streams #19970

onnxruntime
Regarding copy inputs before inference, flush the stream which copies the input only if the input is consumed by the ops from different streams
#19970

Merged