onnxruntime
[TensorRT EP] Fix bug for DDS output handling for empty tensor
#19575

Merged

[TensorRT EP] Fix bug for DDS output handling for empty tensor #19575

chilo-ms merged 12 commits into main from chi/trt_dds_fix

fix bug

c8496de8

handle zero output tensor

1cd785a1

update

c8dca235

remove cudaStreamSynchronize after cuda memory copy and cuda cast

9a4ecd90

remove unnecessary code

6e2c1ff4

code refactor

649dd1fa

code refactor

27dfb6ed

Use same logic for empty tensor handle

e18eb3c4

lintrunner -a

241252dc

only dummy byte needed for empty tensor

10f1f150

TRT 10 supports int64 so no need to cast

2c2c8fc8

Revert "TRT 10 supports int64 so no need to cast"

e9622019

chilo-ms marked this pull request as ready for review 1 year ago

jywu-msft approved these changes on 2024-03-05

chilo-ms merged d9730c7f into main 1 year ago

chilo-ms deleted the chi/trt_dds_fix branch 1 year ago

Reviewers

jywu-msft

Assignees

No one assigned

Labels

None yet

Milestone

No milestone