onnxruntime
[TensorRT EP] Switch to enqueueV3 with support DDS output (copy version)
#18714
Merged
Merged
[TensorRT EP] Switch to enqueueV3 with support DDS output (copy version) #18714
jywu-msft
merged
39 commits into
main
from
chi/trt_enqueue_v3_output_copy
update
de170d51
update
3affd2ee
update
886bcce2
update
ff9d3d23
merge
ae69ca7b
update
09f24014
Merge branch 'main' into chi/trt_enqueue_v3
1e77cd14
Merge branch 'main' into chi/trt_enqueue_v3
5f82028a
fix bug
8f847ec3
fix bugs
35d54b8d
update
5330dffe
Merge branch 'main' into chi/trt_enqueue_v3
ed4849f8
refactor
98b35ed2
Merge branch 'main' into chi/trt_enqueue_v3
018a6b4c
fix format
0e799924
fix minor bug
bc7e2068
remove redundant code
57ba2089
code refacotr
b1ec7cd0
fix format
96531438
Merge branch 'main' into chi/trt_enqueue_v3
4e40cd34
update
ecc25667
update
7ee0ee03
Merge branch 'main' into chi/trt_enqueue_v3
98c83748
Merge branch 'main' into chi/trt_enqueue_v3
85676882
Merge branch 'main' into chi/trt_enqueue_v3
dc88e6b7
Merge branch 'main' into chi/trt_enqueue_v3
2413e1d0
Add INT32/INT64 and float/double conversion for DDS outputs
99e79dd1
update for adding INT32/INT64 and float/double conversion for DDS out…
e15a8bd2
fix typo
8de13dbb
fix bug for using local buffer
27ea00ea
code refactor and add cleanup for dds_output_allocator_map
4ff9a852
remove kernelcontext_setoutput
f48ebc4b
copy allocation output
dd5dcb96
fix bug
26587220
jywu-msft
commented
on 2023-12-06
jywu-msft
commented
on 2023-12-06
update
b871762a
jywu-msft
commented
on 2023-12-06
work around ortallocator alignment issue.
2e29b5aa
lint
5c108c7c
fix leak
c6d30146
fix enqueue_v3 param check failure
1ef9a154
jywu-msft
approved these changes
on 2023-12-14
yf711
approved these changes
on 2023-12-14
Login to write a write a comment.
Login via GitHub