onnxruntime
fa4cbcd3 - [TensorRT EP] Add new provider option to exclude nodes from running on TRT (#22681)

Commit
1 year ago
[TensorRT EP] Add new provider option to exclude nodes from running on TRT (#22681) Add new provider option `trt_op_types_to_exclude`: - User can provide op type list to be excluded from running on TRT - e.g. `trt_op_types_to_exclude="MaxPool"` There is a known performance issue with the DDS ops (NonMaxSuppression, NonZero and RoiAlign) from TRT versions 10.0 to 10.7. TRT EP excludes DDS ops from running on TRT by default, user can override default value with empty string to include all ops.
Author
Parents
Loading