onnxruntime
Add calibration based INT8 quantization to TensorRT EP
#5842

Merged

Add calibration based INT8 quantization to TensorRT EP #5842

jywu-mysoft merged 6 commits into master from stevenlix/precision

add int8

a6872630

support both native TRT cal table and ORT cal table

cdbf13d4

Merge branch 'master' into stevenlix/precision

e306daad

Merge branch 'master' into stevenlix/precision

85e03e91

add more comments

ef09f5e4

stevenlix requested a review from

HectorSVC 5 years ago

stevenlix requested a review from

jywu-mysoft 5 years ago

stevenlix requested a review from

chilo-ms 5 years ago

stevenlix requested a review 5 years ago

stevenlix changed the title ~~Add calibration based INT8 to TensorRT EP~~ Add calibration based INT8 quantization to TensorRT EP 5 years ago

jywu-mysoft commented on 2020-11-18

Update env variable name and check platform availability for int8/fp16

10881377

jywu-mysoft approved these changes on 2020-11-20

jywu-mysoft merged dfea9292 into master 5 years ago

jywu-mysoft deleted the stevenlix/precision branch 5 years ago

Reviewers

jywu-mysoft

HectorSVC

chilo-ms

Assignees

No one assigned

Labels

None yet

Milestone

No milestone