onnxruntime
[Migraphx EP] Static int8 QDQ support
#17931
Merged
Overview
Commits
33
Changes
View On GitHub

[Migraphx EP] Static int8 QDQ support #17931

PeixuanZuo merged 33 commits into microsoft:main from TedThemistokleous:migraphx_int8_support
TedThemistokleous
TedThemistokleous
TedThemistokleous TedThemistokleous marked this pull request as ready for review 2 years ago
TedThemistokleous
cloudhan
azure-pipelines
github-advanced-security
github-advanced-security commented on 2023-10-18
TedThemistokleous
cloudhan
azure-pipelines
cloudhan
azure-pipelines
github-advanced-security
github-advanced-security commented on 2023-10-19
cloudhan
TedThemistokleous
TedThemistokleous
cloudhan
azure-pipelines
github-advanced-security
github-advanced-security commented on 2023-10-20
github-advanced-security
github-advanced-security commented on 2023-10-20
TedThemistokleous TedThemistokleous force pushed from 35225d12 to b082a99e 2 years ago
cloudhan
azure-pipelines
TedThemistokleous
cloudhan
cloudhan
TedThemistokleous
TedThemistokleous TedThemistokleous changed the title Migraphx Static int8 QDQ support [Migraphx EP] Static int8 QDQ support 2 years ago
cloudhan
cloudhan
azure-pipelines
justinchuby
cloudhan
justinchuby
cloudhan
justinchuby
TedThemistokleous
TedThemistokleous
faxu
TedThemistokleous
faxu
faxu
azure-pipelines
azure-pipelines
TedThemistokleous
faxu
faxu
azure-pipelines
azure-pipelines
faxu
azure-pipelines
faxu
faxu
azure-pipelines
azure-pipelines
TedThemistokleous
jeffdaily-ms
azure-pipelines
jeffdaily-ms
azure-pipelines
jeffdaily-ms
jeffdaily-ms
azure-pipelines
azure-pipelines
TedThemistokleous
cloudhan cloudhan requested a review from justinchuby justinchuby 2 years ago
cloudhan cloudhan requested a review from cloudhan cloudhan 2 years ago
cloudhan cloudhan requested a review from PeixuanZuo PeixuanZuo 2 years ago
TedThemistokleous Add flags for quantize int8
f196e5a1
TedThemistokleous Add pieces to grab calibration data for int8
6ca1f189
TedThemistokleous Remove calibration table things for now
1dd107cd
TedThemistokleous Add in quantization step
5853dcb2
TedThemistokleous update benchmark.py in transformers to allow int8 runs
e5f128df
TedThemistokleous Fix naming for environment env kINT8Enable
8a9555a3
TedThemistokleous Backup changes - int8 + static calibration table hooks
269f5bcb
TedThemistokleous Update pybind api to allow for MIGraphX EP options to be set
26461167
TedThemistokleous Add Verbose options for MIGraphX on EP creation
e84cb585
TedThemistokleous Use ReadDynamicRange from TensorRT EP to reuse cal table for static i…
1d1fb222
TedThemistokleous Include flatbuffer file generated for TRT calibration data types
cf31985f
TedThemistokleous Add hooks for calibration table similar to TensorRT EP
f08e930e
TedThemistokleous Add reading in of calibration table and push to migraphx calibration
299279a8
TedThemistokleous Add support for QLinearAdd, QLinearConv, QLinearMatMul
6d1bfa67
TedThemistokleous Fix initial calibration based on compile
c6f47e1f
TedThemistokleous Lint/Formatting
8f4d63ab
TedThemistokleous Add missing changes for provider info
978c8149
TedThemistokleous gate benchmark.py to migraphx ep for int8
610a6a67
TedThemistokleous Remove MIGraphx from training module
3f68a49c
TedThemistokleous Fix provider define for python lint
7db7fd83
TedThemistokleous Fix format
5a7954b5
TedThemistokleous Remove onnxruntime.quantization from benchmark.py
1675d4f4
TedThemistokleous Fixing linting/formatting and more issues.
9e449abc
TedThemistokleous fixup! Fixing linting/formatting and more issues.
cd8d4339
TedThemistokleous Lintrunner pass
63cce29c
TedThemistokleous Set convert to uint32_t instead of uint64_t
5feabdfb
TedThemistokleous Update things that are breaking builds for MIGraphX EP
b6df9456
TedThemistokleous Further Fixes for C++ lint
82c4178d
TedThemistokleous Additional lintrunner pass - disregarding C++ linter pass
219b513a
Fix typo.
ccc4fdbe
Fix CUDA comment
938dd455
Final lintrunner pass for CI
7c51b947
TedThemistokleous TedThemistokleous force pushed from 9e67abaf to 7c51b947 2 years ago
TedThemistokleous
faxu
faxu
azure-pipelines
azure-pipelines
faxu
azure-pipelines
PeixuanZuo
azure-pipelines
PeixuanZuo
jeffdaily
jeffdaily-ms
jeffdaily-ms dismissed these changes on 2023-11-08
Fix additional lint errors.
037d9285
TedThemistokleous TedThemistokleous dismissed their stale review via 037d9285 2 years ago
TedThemistokleous TedThemistokleous requested a review from jeffdaily-ms jeffdaily-ms 2 years ago
PeixuanZuo
azure-pipelines
PeixuanZuo
azure-pipelines
PeixuanZuo
PeixuanZuo
PeixuanZuo approved these changes on 2023-11-09
PeixuanZuo PeixuanZuo merged 8d503138 into main 2 years ago
TedThemistokleous TedThemistokleous deleted the migraphx_int8_support branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum