TensorRT EP - timing cache #14767
chilo-ms
merged
35 commits into
microsoft:main
from
gedoensmax:tensorrt_timing_cache
add timing cache
3ba51a23
enable timing cache for test
f905d355
Make it only on Linux
086ba0ef
undo last commit
191424b5
Merge branch 'master' into trt_timing_cache
d08ea41f
add 'timing_cache_enable' tensorrt provider options
4fe5a0a2
fix bug
83e251d6
fix bug
5b52f63e
revert modification
4ff502d4
small modification
2dd31943
remove intrumentation code for recording engine build latency
8d75a709
add timing_cache_enable as additional member of internal TensorRT pro…
58e37fc1
fix warning
b707c65d
enable trt timing cache for model tests
48ecbeb5
Merge branch 'master' into trt_timing_cache
e248193f
enable timing cache for model tests
9dc0d162
change pool
0f378b13
change back previous pool
72b76457
change path of trt_timing_cache
2c5ac286
refactor code
93e61f09
Add test cases for timing cache
c9813c21
fix bug
e69723e8
fix bug for CI
c371a6dc
Merge branch 'master' into trt_timing_cache
8da55b5f
fix bug
e513740b
fix bug
4a45c30d
Merge branch 'trt_timing_cache'
be0da225
timing cache test
e38556a2
append compute capability to cache and add force option
bf0b8800
Take timing of first warm up inference
244b437e
Merge branch 'main' into tensorrt_timing_cache
0db18d8a
chilo-ms
commented
on 2023-02-23
chilo-ms
commented
on 2023-02-23
chilo-ms
commented
on 2023-02-23
detailed build log option
5db55ff1
chilo-ms
commented
on 2023-03-01
format changes and adding force timing cache to provider options
6b0be1db
fix pybind OrtTensorRTProviderOptionsV2
c1c3f712
chilo-ms
commented
on 2023-03-08
reset OrtTensorRTProviderOptions
b888fc3a
chilo-ms
approved these changes
on 2023-03-09
Login to write a write a comment.
Login via GitHub