VitisAI EP Context Model #20926
HectorSVC
merged
145 commits into
microsoft:main
from
glen-amd:vitisai-ep-context-model-2
Initial support for EP context models for VitisAI EP
7f6adcb2
Tried fixing a few errors
a94ad9bd
Trying address issues of unrecognized ONNX_NAMESPACE::FunctionProto
0c0e2963
Tried addressing the issues with defining IndexedSubGraph_SourceOfSchema
c1a2a590
Worked around unused variable warning
e40ff6e8
const & non-const compatability of class methods
4aaac631
Commented out SessionOptions related pieces in VAI EP ctor
4e8e0436
Removed or commented out deprecated fields of FunctionProto
ebc02905
Compitible with the deprecated FunctionProto fields
3b0b2b03
lintrunner -a
d86a3eb2
Merge remote-tracking branch 'ms_onnxrt/main' into vitisai-ep-context…
cae97f1e
lintrunner -a; merge upstream main
98d7208b
HectorSVC
commented
on 2024-06-05
HectorSVC
commented
on 2024-06-05
Non-optimal approach to accommodating `VitisAIExecutionProvider::Comp…
ecce0387
Fixed a couple of piecemeals
2ecacff5
Refined some comments
97960571
1) An alternative implementation of EP context feature for VitisAI EP…
d68d4873
Some refactoring
7f5ed75a
Added logging
64aeeacb
More logging
6a94023f
Fixed a few piecemeal errors due to function refactoring
502bead9
Fixed missing const specifier
e17f721c
Added missing const quantifier
55748330
Changed how a couple of header files are included; Renamed .cpp to .cc
8da36b81
Changed logics of loading an EP-context model
988fe9c6
Removed an extra "}"
d93347b4
Refined the file names of EP-context models and context cache (non em…
8d4e2113
Handled SessionOptions in Py binding accordingly
a84363f6
More logging
0673f2d9
Fixed a few failing cases reading cache files
c3f03760
More logging
1a967615
More logging
c6a8cb4b
More logging
9df43891
Accommodated a few more cases for backend cache dirs and keys
204fa56f
Fixed a typo
812b4f5c
Tested an alternative
9442767f
Switched on/off for testing
8c7c663c
Explicitly used PathString in a platform-independent way
3a1a0bd3
Explicitly set log verbosity level
05028018
Revert a couple of most recent changes for testing
76769f73
Fixed a bug due to previous changes
8abb73c7
When a figured-out path is actually not existing, do nothing
bc733782
More verbose loggging
9b2cd8ab
Switched testing
59a05fba
Replace non-ascii chars for nlohman json
1591c41e
Added missing namespace nlohmann
1dd43e4d
Logging for debug. To be removed
f36ab39e
More logging for debugging. To be removed
28576cfc
More logging for debugging. To be removed
2b9e6d7a
More logging for debugging
6fa47a72
More verbose logging for debugging
c0c0ac3d
More verbose logging for debugging
cd99e68a
Reverted a change just made
fc9cac41
More verbose loggnig for debugging. Note all such logs will be elimia…
7480f5e1
More verbose loggnig for debugging. Note all such logs will be elimia…
a1a63bbf
More verbose loggnig for debugging. Note all such logs will be elimia…
07e2cc4c
`struct Status` vs `class Status`
8a8241cb
More verbose logging for verifying ONNXRT memory fault. Note all such…
316c2813
More verbose logging for verifying ONNXRT memory fault. Note all such…
ef971523
Deleted a bad change previously made
49a3b8d0
More verbose logging for verifying ONNXRT memory fault. Note all such…
9efc9148
ONLY testing ModelPath() in VerifyNodeAndOpMatch() called in PerformT…
d2129fe7
More verbose loggign to see the at what points of time the ModelPath …
3d09c735
More verbose logging for locating where std::bad_alloc happened. Note…
c4c03b94
Merge branch 'main' into vitisai-ep-context-model-2
b580b239
github-advanced-security
commented
on 2024-06-14
HectorSVC
commented
on 2024-06-15
Commented out part of the verbose logging
f9ab3764
Merge branch 'vitisai-ep-context-model-2' of https://github.com/glen-…
c6cfacba
Fixed a typo
e3bb6c5a
More logging for debugging. Such logging will be eliminated eventually
406c71ea
Fixed a slip of pen
985a5e6e
Platform compatible PathString
fd5852e9
Platform compatible PathString
b8763efe
Tried addressing a few warning-as-error type conversion issues on Win…
a365aaeb
Squahsed commits
8bfa8f2d
Merge branch 'vitisai-ep-context-model-2' of https://github.com/glen-…
e26f95dd
Squahsed commits
128f0c99
Merge branch 'vitisai-ep-context-model-2' of https://github.com/glen-…
6ec4180b
Code cleaning
4e4dfb75
Windows/Linux compatible string
b6ab6edd
Added more logging
ca18a7a9
Tested filesystem::path string
bf8c53b6
Changed the timing of validating an EP context model
efd4b9e6
Added more validation on the EP context graph
b84bf503
Changed how an EP context model is created
1da40f74
Changed a function prototype that was missed previously
cc153577
Fixed a function signature
dcb05bbe
HectorSVC
commented
on 2024-06-17
HectorSVC
commented
on 2024-06-17
HectorSVC
commented
on 2024-06-17
Fixed the issue with model creation with an empty model proto
2b8f9c3f
Added an extra graph validation to see if model creation succeeds
55b3a0bc
Added extra validation
b9783d02
HectorSVC
commented
on 2024-06-18
Changed part of how an EP model is created and dumped
f5c981b7
Removed changes in core/graph/graph.cc
3e172c80
Uncommented a piece of code commented out before for testnig
69fb30ef
A piece of refinement
8d5c751f
Added more inline comments
d497619c
HectorSVC
commented
on 2024-06-18
Improved logic for dumping an EP context model and validating an EP c…
156a610b
Worked around a "unused variable" warning-error
6ec6b2d5
More verbose logging
1019499d
More verbose logging. Will eliminate them shortly
0f548d90
Forgot to change a function prototype in a header file
972658ef
Worked around the case of (1) CreateEpContextModel using Node::Name()…
31615273
Fixed an issue of missing "const" specifier
55930fa9
Fixed a function declaration signature
720310ca
Tested the other approache to EP context cache
126a11e0
Fixed issues with extra parentheses forgotten to remove
bc95a8dd
Make member variable "info_" mutable
0e185cef
Added checking cache file operation
1339ea31
Added more checking if cache is empty
b6f69c57
Cases where zero compute capabilities are returned
44ddc6b6
More verbose logging. To be removed
a29c5a38
Added required opset_import to ModelProto
230189b2
Added mandatory forward declaration
1ce1edc0
Added the compiled ProtoBuf message OperatorSetIdProto declaration
77a17a61
Added missing namespace prefix
9f930bf3
Added missing const specifiers
42534681
Tried to store ModelProto.opset_import
88a5d6cc
Changed how to iterator over an nlohamn:json object
fe581566
Tried alternative way to stringify a json value
f7f16f07
nlohamn::json iterator value reading
e72d5abe
More verbose logging. To be removed
f0bcb197
Added explicit exception handling for more detailed insights
f0ede0f7
Re-organized and cleaned up the code
6c7b8d1b
Added missing outer class for FusedNodeAndGraph
86a14be4
Fixed a wrong reference to std::reference_wrapper
1ad08006
Fixed slip of pen
bbc754ef
Fixed calling issues to accommodate newly added code
e2c1c415
More verbose logging
39a3feab
More verbose logging
189ee887
Changed how to access JOSN values for Windows compatibility
b498263b
Explicitly converted std::strng to onnxruntime::PathString on Windows
35f66144
Added more logging
6c4f78cb
Turned on/off switches for different approaches
822cbbfd
Turned on/off switches for different approaches
09853e73
Turned on/off switches for testing different approaches
4388fe16
Added more clearer comments
227bbc3b
HectorSVC
commented
on 2024-06-25
HectorSVC
commented
on 2024-06-25
HectorSVC
commented
on 2024-06-25
HectorSVC
commented
on 2024-06-25
Refactory for hiding VitisAI backend details
30b792c8
Explicitly added namespace prefix in header files
9de786ce
Added some to-be-removed logs
738f8aaa
Code cleanup
dc7dd3d4
Code cleanup
c78fd8c1
Merge branch 'main' into vitisai-ep-context-model-2
7b4194cf
Removed un-needed header files
e2aa3d34
Merge branch 'main' of https://github.com/microsoft/onnxruntime into …
a2e5de96
Made changes according to PR https://github.com/microsoft/onnxruntime…
e3033e4c
Got rid of upstream-deprecated onnxruntime::Path::ToPathString()
824c64c0
Dealt with platform-dependent PathString and string
44107131
Fixed slip of the pen
68bdc65e
HectorSVC
approved these changes
on 2024-07-13
Reviewers
Assignees
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub