onnxruntime
Support explicit TRT profiles from provider options
#15546
Merged

Support explicit TRT profiles from provider options #15546

chilo-ms merged 38 commits into main from chi/explicit_trt_profiles
chilo-ms
chilo-ms Initilization
807b6b7d
chilo-ms update
4c2c8395
chilo-ms update
93ef13ea
chilo-ms update
7109ce96
chilo-ms update
2beeb76a
chilo-ms Merge branch 'main' into chi/explicit_trt_profiles
1661f309
chilo-ms update
ca9dbfa3
chilo-ms fix bug
4e93566e
chilo-ms fix bug
12e8613b
chilo-ms fix bug
5c5aaa81
chilo-ms Merge branch 'main' into chi/explicit_trt_profiles
bdc3d4a8
chilo-ms fix bug for adding three provider options
dc2e68af
chilo-ms fix warning
edd6c4e1
chilo-ms Merge branch 'main' into chi/explicit_trt_profiles
227e2de9
chilo-ms update
f0b89efb
chilo-ms chilo-ms requested a review from jywu-msft jywu-msft 2 years ago
chilo-ms chilo-ms requested a review from yf711 yf711 2 years ago
chilo-ms chilo-ms changed the title Support explicit TRT profiles Support explicit TRT profiles from provider options 2 years ago
jywu-msft
chilo-ms impose constraint
7f8ea4d5
chilo-ms Merge branch 'main' into chi/explicit_trt_profiles
2c814b7b
tianleiwu
chilo-ms
chilo-ms add engine_cache_built_with_explicit_profiles
f9c950e1
tianleiwu
tianleiwu commented on 2023-04-24
tianleiwu
tianleiwu commented on 2023-04-24
tianleiwu
chilo-ms add exception handler
a321d9d7
chilo-ms fix typo
9743142c
chilo-ms Merge branch 'main' into chi/explicit_trt_profiles
e28dca03
chilo-ms fix bug
3dbb1858
chilo-ms fix bug
f8139773
chilo-ms fix bug
e38bca10
chilo-ms update comments
aac10967
chilo-ms add profile serialize/deserialize V2 functions
b350118b
chilo-ms Apply serialize/deserialize V2
d54c5460
chilo-ms update serialize/deserialize V2
b24eb641
chilo-ms Merge branch 'main' into chi/explicit_trt_profiles
2efd4def
jywu-msft
chilo-ms fix python binding code
a35a3205
chilo-ms refactor serialization/deserializationV2
ef730af5
chilo-ms
chilo-ms Use serialize/deserializeV2 for implicit/explicit profiles
0fc46458
chilo-ms remove trt_engine_built_with_explict_profiles
7d1a7c0c
chilo-ms merge main
c45a7ecf
chilo-ms fix format
943cef46
chilo-ms fix bug and format
54bbb977
chilo-ms fix bug and format
7b375d56
chilo-ms fix bug
9adfcc38
jywu-msft
jywu-msft approved these changes on 2023-04-30
tianleiwu
tianleiwu approved these changes on 2023-05-01
chilo-ms chilo-ms merged 6e652d05 into main 2 years ago
chilo-ms chilo-ms deleted the chi/explicit_trt_profiles branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone