microsoft/onnxruntime

Pull Requests Commits

refactor exection plan

chentaMS committed 3 years ago

340e210f

a temporary fix for release plan bug

chentaMS committed 3 years ago

635b5c67

fetch stream from provider for seq exe

RandySheriffH committed 3 years ago

067c7b2c

unblock seq executor on cuda

RandySheriffH committed 3 years ago

20a8146f

a temp fix for seq executor

chentaMS committed 3 years ago

dbf2d2de

patching test case

RandySheriffH committed 3 years ago

126c1126

Merge branch 'PE' of https://github.com/microsoft/onnxruntime into PE

RandySheriffH committed 3 years ago

d0b38f70

add unit test for para exe plan

RandySheriffH committed 3 years ago

27ef1899

remove stream pool

chentaMS committed 3 years ago

9edc36ce

chentaMS committed 3 years ago

29471f52

update the stream aware arena implementation with a vector clock based approach

chentaMS committed 3 years ago

9a9fa014

Merge branch 'PE' of https://github.com/microsoft/onnxruntime into PE

chentaMS committed 3 years ago

49b02203

Merge branch 'PE' of https://github.com/microsoft/onnxruntime into PE

RandySheriffH committed 3 years ago

652e2ba0

implement parallel allocation and release plan

RandySheriffH committed 3 years ago

2a089a06

update test case

chentaMS committed 3 years ago

aaf7ef51

chentaMS committed 3 years ago

c4a7e570

chentaMS committed 3 years ago

3c8e7e7f

clean stream when execution is done

chentaMS committed 3 years ago

7e779aa7

turn cuda kernel to sync

chentaMS committed 3 years ago

3007de09

use stream aware allocator in execution frame

chentaMS committed 3 years ago

0d9e643d

stream aware arena

chentaMS committed 3 years ago

05564ab8

chentaMS committed 3 years ago

81b3b2fe

add max_stream option; add stream pool for stream reusing

chentaMS committed 3 years ago

8bd777a4

move the stream handle registry to session state

chentaMS committed 3 years ago

d285469d

instantiate stream when run call arrived; add stream to opkernelcontext; use a temp hack for cuda kernel, need to remove it when prepare PR

chentaMS committed 3 years ago

393ec273

Merge branch 'PE' of https://github.com/microsoft/onnxruntime into PE

chentaMS committed 3 years ago

6d29bb74

remove stream from opkernel info

chentaMS committed 3 years ago

0c2e213f

resolve conflict

RandySheriffH committed 3 years ago

8f6d9964

Merge branch 'PE' of https://github.com/microsoft/onnxruntime into PE

RandySheriffH committed 3 years ago

076ebfce

add missing file

chentaMS committed 3 years ago

3a819b21

Older