OpenVINO EP v2.0 #3585

jywu-msft merged 286 commits into microsoft:master from intel:openvino-ep-v2
smkarlap
ynimmaga Added FP16 transformations
85caec49
suryasidd Revert "Added CMAKE_BUILD_TYPE to make building dynamic"
f779bb03
ynimmaga Added FP16 transformations for FP16 builds
e4af5428
smkarlap Backend logic cleanup
5380a3fc
smkarlap Merge remote-tracking branch 'origin/uep_unsupported_ops' into unifie…
ae4bf5dd
smkarlap Merge branch 'unified-ep-dev' into manohar/test-runner-bug
d3859467
smkarlap removed commented out code
290b418a
smkarlap Merge branch 'manohar/test-runner-bug' into 'unified-ep-dev'
6e52ac71
suryasidd Disabled default optimization for Intel EP
0ac88126
Fix missed plugins.xml for python bindings
f22b3a6a
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
2a2cab86
suryasidd Merge branch 'mt/missed_plugins_xml' into 'unified-ep-dev'
b11a6576
suryasidd Fixed the build after latest master changes
f4edc5c9
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
cf79b4a9
suryasidd Disabled unsupported ops for accelerators
75dc9d76
suryasidd Added some more disabled ops
d748ac6d
suryasidd Added environment variable to enable debugging
3b4f9758
suryasidd Added more debug statements
9bb5f9c3
smkarlap Merge branch 'debug_env' into 'unified-ep-dev'
253aa526
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
aae63ae2
suryasidd Fixed unsupported ops list for GPU and VPU
ac6ef88c
suryasidd Fixed unsqueeze unit tests
71bea20f
ynimmaga Merge branch 'unsqueeze_fix' into 'unified-ep-dev'
a711e318
suryasidd Added error message to the status
27b34680
smkarlap Overwrite Model proto with shape info from data
feed36bf
suryasidd Removed print statement and disabled where op
b4fc6f3d
suryasidd Disabled Reshape with Empty initializer
cb6787cc
suryasidd Added more debug statements for 1P
7ca6036c
smkarlap Don't allow 1D inputs with symbol for dimension
388192db
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
56679716
smkarlap Merge branch 'manohar/dyn_shapes' into 'unified-ep-dev'
861f7e05
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
6be5aaec
suryasidd Disabled some 3rd phase ops
7399d428
suryasidd Disabled split and added zero dimension check for OutputDefs
2fdb779a
suryasidd Cleanup zero dimensionality check
89064fa4
suryasidd Added different data type check for inputs and initializers
e987807f
suryasidd Added conditions for Mod, Cast and Pad
53cdc2ac
suryasidd Removed unused variable
b77ba910
smkarlap Merge branch 'disable_phase3_ops' into 'unified-ep-dev'
b8a348cc
suryasidd Disabled scan and added conditions for squeeze
a5f89658
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
1672ad44
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
1430cc41
suryasidd Added changes for fixing all C++ unit tests
df940c4d
smkarlap Implements Backend Manager class for caching
92e44625
smkarlap clean up commented blocks
dfa66975
smkarlap clang-formatting
f6d44810
smkarlap Read I/O type info from ModleProto
0773e7fd
smkarlap code cleanup
ab204bc4
smkarlap clang-formatting
619293ab
smkarlap Merge branch 'manohar/cache-infer-reqs' into 'unified-ep-dev'
f76aebd6
suryasidd Added print statement for jenkins
02e4d48c
suryasidd Disabled some python tests
ea4d444f
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
5e5eceaf
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
a184b738
suryasidd Added conditions for BatchNorm in GetCapability
c3c28c3b
suryasidd Merge branch 'bn_changes' into unified-ep-dev
b4098e7a
Fixed failed tests
78a46f4b
suryasidd Revert "Added conditions for BatchNorm in GetCapability"
afe60cf3
suryasidd Merge branch 'mbencer/IgnoreSessionInitializeExceptions' into 'unifie…
d03bbe50
suryasidd Added Intel to onnxruntime backends
365b5f23
smkarlap pick up vars set by OV package setupvars.sh
8199e029
suryasidd Added conditions for Identity
ca359acc
smkarlap remove a few cout prints
7163b538
suryasidd Added conditions for GPU_FP32 unit tests
d2f87fab
smkarlap Merge branch 'release-cmake' into unified-ep-dev
bbeeaaf9
smkarlap Revert "pick up vars set by OV package setupvars.sh"
ef34654a
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
d451f587
suryasidd Commented out fatal message for protobuf
eef2e93b
smkarlap Add interface class for current backend
ee5c7b32
smkarlap moved common logic to base class
a8771178
smkarlap simplified cpu backend
48ac936c
smkarlap Removed unused headers
cc0ec2e5
smkarlap use vectors to save i/o tensors for windows compatibility
83648437
smkarlap move utils fxns to backend_utils namespace
b04fbb15
smkarlap rename ov_backend to ibackend
49b9f71b
smkarlap Factory pattern for backend creation
58a4a917
smkarlap rename CPU backend to Basic backend
8a0c8437
smkarlap renamed to vad-M and added to factory list
89a5fcf4
smkarlap Merge branch 'hw-backend' into 'unified-ep-dev'
7e5edb6a
suryasidd Added conditions for VPU
a10b7307
suryasidd Merge branch 'unified-ep-dev' into surya/vpu_conditions
ff91510d
smkarlap Merge remote-tracking branch 'origin/master' into unified-ep-dev
262d44ac
suryasidd Added print statements
e8b23de1
suryasidd Changed the logic for checking for symbolic shapes
59b4c805
smkarlap Merge branch 'surya/symbolic_shapes_check' into 'unified-ep-dev'
9f1f4245
suryasidd Merge branch 'unified-ep-dev' into surya/vpu_conditions
6430d3ef
suryasidd Modified logic for zero dimension check
5dab5366
suryasidd Removed VPU single dimension condition
c9006ef8
suryasidd Merge branch 'unified-ep-dev' into surya/vpu_conditions
67b2e04c
suryasidd Removed comments
96df9659
suryasidd Merge branch 'surya/vpu_conditions' into 'unified-ep-dev'
ca2f9a21
suryasidd Modified logic in DimensionCheck method
653ed57d
smkarlap Remove legacy OpenVINO EP
96e61ce2
smkarlap Rename Intel EP to OpenVINO EP
97f3be9e
suryasidd Added unique names to the subgraphs
9deb551f
suryasidd Removed subgraphs with only constant inputs
6792191c
suryasidd Modified subgraph partitioning algorithm to remove const input subgraphs
db09bc7a
suryasidd Apply suggestion to onnxruntime/core/providers/openvino/openvino_exec…
045e4bc8
smkarlap Merge branch 'surya/remove_const_input_subgraphs' into 'unified-ep-dev'
89a7b7e7
suryasidd Tracking output names to fix the output order bug
d6f42cc9
suryasidd Changed output names to a unordered map
b41ad8a3
suryasidd Modified logic to check for symbolic input shapes
66112611
smkarlap Merge branch 'surya/symbolic_dims_check' into 'unified-ep-dev'
02132ce7
smkarlap Merge branch 'surya/fix_output_orders' into 'unified-ep-dev'
55d1f176
smkarlap Merge latest updates from upstream master
559a763d
suryasidd Added empty model path to Model constructor
6b5ce9fb
suryasidd Made necessary changes to cmake to build from the binary package
d2b5e666
suryasidd Changed INTEL_CVSDK_DIR to INTEL_OPENVINO_DIR
da9619b2
smkarlap Enable dyn device selection with C++ API
e7002769
suryasidd Added Round operator to unsupported list
031c9e65
suryasidd Modified subgraph partition logic for MYRIAD
b05a4bcc
suryasidd Removed supported ops from the list
1c85908c
smkarlap Enable dyn dev selection in Py API's
30d90aa6
smkarlap Add documentation for dynamic device selection
392dabc8
smkarlap Use MYRIAD || HDDL instead of VPU
058e4b3e
suryasidd Removed temporary cast of Int64 to FP32
652a0887
smkarlap Merge pull request #8 from intel/manohar/dyn-dev-select
c9465459
gundaarx Disabled unit Tests for CPU_FP32 and GPU_FP32
ef751b87
suryasidd Removed default "CPU" from unit tests to allow overriding
ad25e9fb
suryasidd Removed ops Concat, Squeeze, Unsqueeze from unsupported list
549a9423
suryasidd Merge branch 'openvino-ep-v2' into surya/add_supported_ops
fce302b5
suryasidd Merge branch 'openvino-ep-v2' into surya/fix_myriad_subgraph
b390c39d
suryasidd Get the device id from info
f95bca0a
suryasidd Removed overwriting device_id and precision
f5c50fd4
suryasidd Merge branch 'openvino-ep-v2' into surya/fix_myriad_subgraph
95c919ab
suryasidd Merge pull request #9 from intel/surya/fix_myriad_subgraph
d5fe5760
suryasidd Merge branch 'openvino-ep-v2' into surya/add_supported_ops
e5987679
suryasidd Merge pull request #10 from intel/aravind/fix_cpu_gpu_fp32_tests
b650e925
suryasidd Enabled ConvTranspose and EyeLike
949ae247
suryasidd Reordered unsupported ops in alphabetical order
ed2ad0d6
suryasidd Fixed syntax error
22f5b1bf
suryasidd Fixed syntax error
d370ae16
smkarlap Code clean-up: Handle exceptions, logs and formatting
0657e702
smkarlap remove debug print from pybind code
8b15407f
smkarlap updated docs with ops and models
00ce1346
smkarlap formatting prints
7aa7e12b
suryasidd Added default values for c and j for openvino
312e3bdd
suryasidd Overriding c value with default for perftest
c44c3173
suryasidd Merge pull request #12 from intel/surya/override_values_to_default
e57e42fc
smkarlap Merge latest updates form master into openvino-ep-v2
a1f4f467
smkarlap fix VAD-M device string bug
ef6bde5e
smkarlap Add IE error details to exceptions
d4c9ae34
smkarlap Use IE specific device names in EP
5a775bb2
smkarlap Add VAD-F (FPGA) device support
f35829b3
suryasidd Removed unecessary libraries from whl package
7eca631f
smkarlap Code changes for Windows compatibility
fd639e16
smkarlap Add VAD-F option to python API
6bbdfda9
smkarlap [revert before merge] cmake changes for RC
13b8cf9e
smkarlap Enable Windows build in CMake
9b0aef69
smkarlap Unset macro OPTIONAL for windows builds
33c0f8e7
smkarlap Merge latest updates from master into openvino-ep-v2
965e4c9e
smkarlap Use a single copy of plugin/IE::Core
26580d4a
smkarlap Remove restriction of single subgraphs for myriad
7c31bb77
suryasidd Passed subgraph name to Backend to enhance log statements
52336102
suryasidd Disabled zero dimension conditions
faa6443a
suryasidd Disabled concat to remove zero dims
c61a04e5
suryasidd Enabled building ngraph as part of ORT
203dea40
suryasidd Removed serializing and added versioning
518f84d2
smkarlap Merge pull request #14 from intel/surya/enable_ngraph_source
d69d3343
suryasidd Fix CPU_FP32 unit tests
c9367de4
suryasidd Removed unecessary condition
776032d4
smkarlap add ngraph.so.0.0 to .whl
6e437656
suryasidd Check for zero dimensions only for inputs and outputs
5d329cec
smkarlap Merge branch 'openvino-ep-v2' into manohar/uep-windows-enabling
0f303f1e
suryasidd Restrict loading only 10 subgraphs on myriad
9c172023
smkarlap Merge branch 'openvino-ep-v2' into manohar/fpga-support
b8074876
smkarlap Build ngraph.dll within UEP. Doesn't link yet
a1a669c1
smkarlap Rename Linux included libngraph.so to libovep_ngraph.so
cc976237
smkarlap use output_name cmake properties for lib name
cd9e9db4
smkarlap CMake code cleanup
18177a30
smkarlap Merge branch 'openvino-ep-v2' into manohar/uep-windows-enabling
56d0ec92
smkarlap Rename WIN32 included ngraph.dll to ovep_ngraph.dll
0e4f6639
smkarlap fix .so name format in lib_name.patch
7931ab68
suryasidd Added myriad config for networks without 4 dimensions
11670d05
smkarlap Refactor code and add Batching support
614defe1
suryasidd Disabled some broken tests
67e63db1
smkarlap use input_indexes to avoid batch-checking initializers
5fb89dd8
smkarlap Fetch latest updates from 'openvino-ep-v2'
e76f3d32
smkarlap Merge pull request #15 from intel/manohar/batching
6215e695
smkarlap Avoid static initialization order error on WOS
b00555be
suryasidd Added candy to broken tests
3209baac
gundaarx InternalCI changes for 2020.2
e92ac4ab
gundaarx Updated DLDT instructions
9619a272
smkarlap Merge branch 'manohar/win-debug' into openvino-ep-v2
fdee3647
gundaarx Unsaved changed in install_openvino.sh
13cbdad8
gundaarx Changes after manual check
d3cb2061
smkarlap Remove custom ngraph onnx_import build for WOS
ef19b0ae
smkarlap Merge branch 'manohar/win-debug' into openvino-ep-v2
76bc7576
suryasidd Merge branch 'openvino-ep-v2' into surya/add_myriad_config
c1301825
smkarlap Remove FP32ToFP16 ngraph pass
ec962ca5
smkarlap Surround debug logic by #ifndef NDEBUG
6292ae4d
smkarlap remove invalid TODO comments
6c1f06c4
smkarlap removed references to ngrpah-ep
862f4f8f
smkarlap clang-formatting
fee8ff0f
smkarlap remove commented code
87dda039
smkarlap comment edits
aa336aad
smkarlap updating copyright year to that of first OpenVINO-EP release
fe553475
smkarlap remove redundant log msg
f2752fa7
smkarlap Merge pull request #17 from intel/surya/add_myriad_config
766c0e0d
smkarlap Merge branch 'openvino-ep-v2' into manohar/cleanup
446377f8
smkarlap Merge pull request #17 from intel/surya/add_myriad_config
766c0e0d
smkarlap Merge remote-tracking branch 'intel/master' into upstream-merge
f4f9c53f
suryasidd Modified operator and topology support
1c1c3e08
smkarlap Merge branch 'openvino-ep-v2' into surya/doc_changes
0acce9b9
smkarlap Update build instructions
50bdd642
smkarlap doc formatting
2cd4da8f
suryasidd Fixed clip unit tests
5321ebb1
suryasidd Merge branch 'openvino-ep-v2' into surya/fix_clip_tests
b65ca4c2
suryasidd Merge branch 'openvino-ep-v2' into surya/fix_clip_tests
d2135505
suryasidd Revert "Remove FP32ToFP16 ngraph pass"
283a92ec
suryasidd Applying FP16 transformation only for GPU FP16
6f6c21d4
suryasidd Fixed GPU FP32 python tests
b853c2ad
smkarlap automatically use full protobuf
823210b3
smkarlap disable onnxrt server for now
b2983a38
suryasidd Disabled upsample
f785a6ba
smkarlap update dockerfile instructions
5d1cf2db
gundaarx Removed MO paths and added ngraph path
78ddb4cc
smkarlap Remove OVEP from ORT Server docs
b80033ca
gundaarx Updated path to Ngraph lib
e3560588
smkarlap Merge pull request #16 from intel/aravind/docker_file_changes
d19f34c2
suryasidd Disabled Resize and some other python tests
011b92af
suryasidd Removed unnecesary header files
25f877f2
suryasidd Merge branch 'surya/fix_gpu_fp32_py_tests' into openvino-ep-v2
cf8b8113
smkarlap smkarlap requested a review 6 years ago
smkarlap smkarlap changed the title OpenVINO EP v2 OpenVINO EP v2.0 6 years ago
snnn
snnn commented on 2020-04-18
jywu-msft
azure-pipelines
jywu-msft
azure-pipelines
jywu-msft
jywu-msft commented on 2020-04-19
smkarlap Use commit SHA to fetch ngraph repo
802c71f7
smkarlap Avoid un-needed file changes due to version update
1be5b6d8
jywu-msft
azure-pipelines
jywu-msft
smkarlap Merge remote-tracking branch 'master' into openvino-ep-v2
8908858f
smkarlap
jywu-msft
azure-pipelines
jywu-msft
jywu-msft jywu-msft requested a review from HectorSVC HectorSVC 6 years ago
suryasidd Fixed clip tests
26ab2bee
suryasidd Merge branch 'fix_clip_tests' into openvino-ep-v2
0b9c6aa3
suryasidd
HectorSVC
azure-pipelines
HectorSVC
azure-pipelines
HectorSVC
azure-pipelines
HectorSVC
suryasidd
suryasidd Fixed Pow, max and min onnx tests
7d0323c9
HectorSVC
azure-pipelines
jywu-msft
jywu-msft commented on 2020-04-20
jywu-msft
jywu-msft commented on 2020-04-20
jywu-msft
jywu-msft commented on 2020-04-20
HectorSVC
HectorSVC commented on 2020-04-20
HectorSVC
HectorSVC commented on 2020-04-20
jywu-msft
jywu-msft commented on 2020-04-20
HectorSVC
HectorSVC commented on 2020-04-20
smkarlap build.md doc typo
55b2c050
smkarlap Update cmake patch command for ngraph src
8618f88a
smkarlap remove dead cmake code for onnxruntime_USE_OPENVINO_BINARY
bdfd4520
HectorSVC
HectorSVC commented on 2020-04-21
smkarlap use spaces instead of tab
e0ccbc6e
smkarlap remove commented code
01b340e0
HectorSVC
azure-pipelines
HectorSVC
azure-pipelines
jywu-msft
azure-pipelines
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
jywu-msft
jywu-msft commented on 2020-04-21
smkarlap Add info about protobuf version
59f81f08
smkarlap edit debug env var and enable for WIN32
bee7ab3a
smkarlap specify only version tag of 2020.2 for dockerbuilds
789accac
smkarlap remove unnecessary file changes
03bd700a
jywu-msft
smkarlap Pass empty string as default argument to C# tests
78622d83
smkarlap Use ${OPENVINO_VERSION} to name openvino install directory in CI builds
89e72adb
suryasidd
jywu-msft
suryasidd Enabled unnecessarily disabled tests
37c2ae2c
suryasidd Fixed ngraph protobuf patch
d0dbc383
suryasidd Fixed error in protobuf patch
0ec3dc26
jywu-msft
jywu-msft commented on 2020-04-22
HectorSVC
azure-pipelines
jywu-msft
smkarlap Revert "Use ${OPENVINO_VERSION} to name openvino install directory in…
9fa9c203
smkarlap
smkarlap Remove unsetting OPTIONAL macro
93f30c57
HectorSVC
azure-pipelines
smkarlap Use a null string default argument for C# API
6fedeab3
smkarlap Set OpenVINO version yml files and pass to CI Docker builds
c8f24b84
jywu-msft
azure-pipelines
jywu-msft
azure-pipelines
smkarlap Documentation: recommendation and instructions for disabling ORT grap…
0ab8ebb3
jywu-msft
smkarlap more doc updates
a92b5bb8
smkarlap Merge latest updates from branch 'master' into openvino-ep-v2
2e058d67
suryasidd Reduced the number of models according to CI time constraints
cac6736d
jywu-msft
azure-pipelines
HectorSVC
azure-pipelines
jywu-msft
jywu-msft approved these changes on 2020-04-24
jywu-msft jywu-msft merged 6d4f2f5b into master 6 years ago
smkarlap smkarlap deleted the openvino-ep-v2 branch 5 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone