onnxruntime
[QNN EP] Reduce overhead of QNN context binary loading
#17965

Merged

[QNN EP] Reduce overhead of QNN context binary loading #17965

HectorSVC merged 6 commits into main from qnn_cache_overhead

Avoid string copy for the QNN context binary

d9bf69ea

Update the QNN context loading to avoid extra string buffer copy

2d5018f5

HectorSVC requested a review from

adrianlizarraga 2 years ago

HectorSVC requested a review from

jywu-msft 2 years ago

revert changes unrelated

c9a13b6f

Fix UT failure

d5ec44c6

Merge branch 'main' into qnn_cache_overhead

7ee58e2a

remove qnn_cache_model_handler_.reset(); from Compile in case there c…

ff40a218

jywu-msft approved these changes on 2023-10-18

HectorSVC merged 35ecce45 into main 2 years ago

HectorSVC deleted the qnn_cache_overhead branch 2 years ago

Reviewers

jywu-msft

adrianlizarraga

Assignees

No one assigned

Labels

None yet

Milestone

No milestone