PR #13495 Multi-stream execution support

squashed commit from PE branch

53ac1d60

souptc changed the title ~~squashed commit from PE branch~~ Multi-stream execution support 3 years ago

souptc commented on 2022-10-28

jslhcl commented on 2022-10-28

yuslepukhin commented on 2022-10-28

pranavsharma commented on 2022-10-28

edgchen1 commented on 2022-10-29

jslhcl commented on 2022-10-30

jslhcl commented on 2022-10-31

avoid using std function for tensor create/delete

bb5c8738

fix more comments in PR

4a75c0f9

avoid std function when allocate scratch buffer

6cbd2f8a

merge from main

aff38d9d

fix winml build

e5ffbe04

Refactor graph partitioner for multi-stream PR (#13537)

ec97c30d

fix moving allocator ptr; fix the line length; explicit constructor

bea5c1dd

skottmckay commented on 2022-11-01

skottmckay commented on 2022-11-02

yuslepukhin commented on 2022-11-03

fix win build break; fix more comments in PR

fc852fb2

edgchen1 commented on 2022-11-05

jslhcl commented on 2022-11-07

copy the first tensor to desired stream in DataTransferManager (#13566)

c5c300f7

cuda sync after ExecuteSubGraph() in if.cc (#13580)

9f68b900

jslhcl commented on 2022-11-08

Merge branch 'main' of https://github.com/microsoft/onnxruntime into …

bee7c407

fix comments in PR; and fifix the cpu build

dae660a1

Merge branch 'chenta/multi-stream' of https://github.com/microsoft/on…

e8ae8ddb

Merge branch 'main' of https://github.com/microsoft/onnxruntime into …

22f71954

status check after calling ExecuteSubGraph()

3ec5491d

yuslepukhin commented on 2022-11-09

Add multiple unit test cases for multi-stream PR (#13595)

3de239d3

fix comments in pr; fix orttraining pipeline; fix wsam pipeline

dd37f602

Merge branch 'main' into chenta/multi-stream

26b6c1c3

fix the wrong lock

993bdd54

jslhcl commented on 2022-11-19

merge from main

5de16e63

test new topo order 2 in pipeline

27cf7fae

fix a boundary issue

2ec96ad2

only execute barrier step when out of current range, and for training…

f339e476

jslhcl requested a review 3 years ago

merge from main

98546041

merge from main again

1d3fb02f

squshed commits from leca/amd (#13547)

b85cd9f7

fix compliance issue

4520c1ef

merge from main

df355c83

exclude multi-stream logics from planner for minimal build

53ea3225

undo inline container

c7576664

Merge branch 'rashuai/multi-stream-minimal' into chenta/binary_size_test

4edef51a

skil stream for minimal build

5527460a

fix normal build

b1848f39

exclude multi-stream logics from planner for minimal build (#13812)

fc10aef4

Merge branch 'main' into chenta/multi-stream

38d5fcfc

merge from multi-stream branch

3ac4ac1e

merge from ain

3d860772

fix a merge error

20b80f53

merge from main

8c013f77

Merge branch 'chenta/multi-stream' into chenta/binary_size_test

c02f5e55

fix the benchmark build

3155673e

merge from main and resolve conflicts

782826af

make some model tests run parallel (#13834)

30831329

pengwa commented on 2022-12-08

disable parallel model test for dnnl to avoid dnnl pipeline crash

852d10d1

UT for CreatePlan() function under multi stream scenario (#13848)

ccc548bb

Fix migraphx EP link error (#13880)

d873aabe

fix some comments about training code

fe6962ef

Merge branch 'chenta/multi-stream' of https://github.com/microsoft/on…

bdf27040

remove unused functions (#13763)

d614bdc6

Unit test for bfc_arena (#13708)

009aae13

Reenable check-freed (#13917)

ea3d83d9

merge from main

b830a017

jslhcl force pushed from 2e5cdc2c to b830a017 3 years ago

Merge branch 'main' into chenta/multi-stream

59753794

use smart pointer for CpuBuffersInfo for cuda and rocm EP (#13931)

b6b9d6c1

pranavsharma dismissed these changes on 2022-12-13

skottmckay commented on 2022-12-13

souptc dismissed their stale review via a8d4a6b6 3 years ago

jslhcl force pushed from a8d4a6b6 to b6b9d6c1 3 years ago

merge from main and resolve cpu/transformers/beam_search.cc beam_sear…

c6ddb920

merge from main and resolve provider_bridge_provider.cc

1bac37cd

Merge branch 'main' of https://github.com/microsoft/onnxruntime into …

58fe86e8

merge from main and resolve cuda/quantization/fake_quant.cc

83a14cb2

jslhcl approved these changes on 2022-12-15

souptc merged a81faee4 into main 3 years ago

souptc deleted the chenta/multi-stream branch 3 years ago

onnxruntime
Multi-stream execution support
#13495

Merged

Multi-stream execution support #13495

onnxruntime Multi-stream execution support #13495 Merged

Multi-stream execution support #13495

onnxruntime
Multi-stream execution support
#13495

Merged