onnxruntime
[EP ABI] API to get external initializer info + lazy load external OrtValues
#25482
Merged
Merged
[EP ABI] API to get external initializer info + lazy load external OrtValues #25482
adrianlizarraga
merged
43 commits into
main
from
adrianl/ep-plugin-ext-ort-value-load
Adjust InlineIfNode
e4c82442
Merge branch 'main' into yusleoukhin/ort_initializers_ii
5dc217e4
Fix a bug in Initializer::ToProtoWithOrtValue
ffb9bbe0
Address type conversion
e19b9384
Adjust ToProto() handling of in external data in memory
564c29f4
Make CoreML accept external initializers
507eb560
Fix handling of external data in ToProto*()
5e894985
Fix compiler error
fdcdc12b
Merge branch 'yuslepukhin/ort_initializers_mac' into yusleoukhin/ort_…
6e29d73c
Address compile error in Mac code
a0635b7f
Merge branch 'main' into yusleoukhin/ort_initializers_ii
e81b06c7
Adjust in memory references when saving optimized model
4cbddc98
Merge branch 'main' into yusleoukhin/ort_initializers_ii
6ab9839c
Address ToGraphProto() issues
582f27ca
Fix ToGraphProto() and recreate test databases for test_embedlayer_fu…
a636579a
GCC not happy about attr placement
83c313f3
Address build error
2c0f97ee
Address compiler error
5c157252
Adjust test data for fastgelu fusion
a6b25763
[EP ABI] Load external initializer OrtValues on demand
bf4e81cf
Add comment about unique_ptr<OrtValue>
70776545
yuslepukhin
commented
on 2025-07-21
Address review comments
f59c9c69
Add comment and resolve compiler error
64de3151
Update utility to only load OrtValue for external initializers
ff490464
Add unit tests that load external initializers as OrtValues on deman
820400e9
Dont require non-minimal build to load an external initializer into a…
38de20ff
yuslepukhin
commented
on 2025-07-22
yuslepukhin
commented
on 2025-07-22
yuslepukhin
commented
on 2025-07-22
yuslepukhin
commented
on 2025-07-22
yuslepukhin
commented
on 2025-07-22
yuslepukhin
commented
on 2025-07-22
yuslepukhin
requested changes
on 2025-07-22
Add draft of APIs to get external initializer info
582d6ba0
Address some review comments
eb6a4a13
Clean up before refactor to incrementally build ext_initializer_infos_
b3b384ca
Address review comments
397fd134
Test the new API functions to get external initializer information
a9446bad
Address ReplaceInitializedTensor
74adc0ca
incrementally add elements to external_data_info_ as needed
b6073aab
adrianlizarraga
changed the title
Address review comments
93d56144
Clean up
5b2f994c
Merge branch 'yusleoukhin/ort_initializers_ii' into adrianl/ep-plugin…
8fe5d113
Correct tensor size calculation
15e6d5f0
Test and fix cases where we add an entry to external_data_infos_ for …
9fd06a0d
Use HasExternalDataInFile just to be more general
9a8778bb
Base automatically changed from
yusleoukhin/ort_initializers_ii
to
main
214 days ago
Merge main and fix conflicts
647e6598
adrianlizarraga
changed the title 
javier-intel
approved these changes
on 2025-07-23
adrianlizarraga
commented
on 2025-07-23
Apply suggestions from code review
42aba9b5
Address more review comments
786e6d7d
yuslepukhin
commented
on 2025-07-23
Address review comment: do not cache OrtValue over external initializ…
e65855db
yuslepukhin
commented
on 2025-07-23
yuslepukhin
commented
on 2025-07-23
yuslepukhin
approved these changes
on 2025-07-23
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub