microsoft/onnxruntime

Pull Requests Commits

clean stream when execution is done

chentaMS committed 3 years ago

7e779aa7

turn cuda kernel to sync

chentaMS committed 3 years ago

3007de09

use stream aware allocator in execution frame

chentaMS committed 3 years ago

0d9e643d

stream aware arena

chentaMS committed 3 years ago

05564ab8

chentaMS committed 3 years ago

81b3b2fe

add max_stream option; add stream pool for stream reusing

chentaMS committed 3 years ago

8bd777a4

move the stream handle registry to session state

chentaMS committed 3 years ago

d285469d

instantiate stream when run call arrived; add stream to opkernelcontext; use a temp hack for cuda kernel, need to remove it when prepare PR

chentaMS committed 3 years ago

393ec273

Merge branch 'PE' of https://github.com/microsoft/onnxruntime into PE

chentaMS committed 3 years ago

6d29bb74

remove stream from opkernel info

chentaMS committed 3 years ago

0c2e213f

resolve conflict

RandySheriffH committed 3 years ago

8f6d9964

Merge branch 'PE' of https://github.com/microsoft/onnxruntime into PE

RandySheriffH committed 3 years ago

076ebfce

add missing file

chentaMS committed 3 years ago

3a819b21

resolve conflict

RandySheriffH committed 3 years ago

b3835af1

reuse release plan from the planner

RandySheriffH committed 3 years ago

583f51a8

chentaMS committed 3 years ago

337ef4ec

log logic stream execution

RandySheriffH committed 3 years ago

04e375dd

comment usage on grouped_ops and streams_per_op

RandySheriffH committed 3 years ago

caba6a34

create session options for stream configuration

RandySheriffH committed 3 years ago

d2477b26

Merge branch 'PE' of https://github.com/microsoft/onnxruntime into PE

chentaMS committed 3 years ago

e32245d0

refine the stream/notification api

chentaMS committed 3 years ago

f7c5a9ec

reuse sequential exe plan by inheritance

RandySheriffH committed 3 years ago

b408452a

define add stream maps to dynamically scaling

RandySheriffH committed 3 years ago

f9559a5c

Merge branch 'chenta/test_pe' into PE

chentaMS committed 3 years ago

8c8cb124

fix build break

chentaMS committed 3 years ago

e25917a6

Merge branch 'master' into chenta/test_pe

chentaMS committed 3 years ago

12259c27

temp fix for IsAsync api

chentaMS committed 3 years ago

44185b8a

separate device and host ops to different logic stream, and add nvtx range for better profiling

RandySheriffH committed 3 years ago

528cd877

Add BFloat16 (bf16) support for ATen (#11546)

Lafi7e committed 3 years ago

Verified 436c4f9b

[trt-ep-perf] Fix upload time of EP perf data (#11531)

adrianlizarraga committed 3 years ago

Verified e45197fa

Newer Older