Add PerThreadContext for TRT EP #16599
jywu-mysoft
merged
44 commits into
main
from
chi/one_trt_context_per_thread
init
17af501b
update
3688bce4
update
ff1e2ec1
Merge branch 'main' into chi/one_trt_context_per_thread
4fd52d40
update
eb5329d6
update
103d06ef
update comment
dcdf1b2d
update
a3f234e4
update
3fef0969
update
08804b2e
fix bug
01318f0c
update
3a7b7541
update
e7364e74
Merge branch 'main' into chi/one_trt_context_per_thread
468e9341
update
03095eee
update
ac429203
update
dd473dee
update
823fdcef
update comment
c0a5b63b
update comment
130bcd2b
update
72321b8c
update
56ebf538
try to fix segfault in CI
eea2ff46
add --extra-verbose to debug
f455ad27
add --extra-verbose to debug
7130d209
temporarily remove RunOnUnlod to debug
4020ae1b
Merge branch 'main' into chi/one_trt_context_per_thread
af797f81
update to debug
920c9655
update
8cfdd23c
refactor and debug
ab8b7cfd
fix segfault issue during thread extis
a506220e
add comments
3a66bf03
remove redundant code
288919b0
refactor
ada0922b
fix format
20e7e2f2
update comments
aa135c71
add unit test
15ce78ba
fix format
2b0592dc
fix comments
22cef756
chilo-ms
changed the title
Merge branch 'main' into chi/one_trt_context_per_thread
41960b9b
fix typo
366dcf63
Merge branch 'main' into chi/one_trt_context_per_thread
2a866f86
jywu-mysoft
commented
on 2023-08-05
add back api lock for 'build engine' block
b6e9c11a
Merge branch 'main' into chi/one_trt_context_per_thread
6d251596
jywu-mysoft
approved these changes
on 2023-08-07
Login to write a write a comment.
Login via GitHub