onnxruntime
[XNNPACK] Support running in multi-thread with seperate pthreadpool
#11762
Merged
Merged
[XNNPACK] Support running in multi-thread with seperate pthreadpool #11762
wejoncy
merged
37 commits into
main
from
jicwen/xnnpack_multithreading
xnnpack with multi-thread
e22fdd2d
fix
edaffb3e
fix
a26b0cc7
Merge branch 'main' into jicwen/xnnpack_multithreading
05224cdc
fix conflict
140098a4
remove unused code
f26eaa13
amend
5e08b12c
thread-pool build-in EP
36daf2c0
support multi-thread for softmax/avgpool
80363e0b
Merge branch 'main' into jicwen/xnnpack_multithreading
a0ced929
partition logs
877b2591
[draft] cpu not spin when run xnnpackep
3bbef4cc
nullptr in draft
1d0bcb64
solution 1:disable cpuspin when create xnnpack EP
ac343ada
wejoncy
changed the title
Update my_ep_factory.cc
762e2453
Update my_ep_factory.cc
ad68a9fb
fix
2dfa209e
remove unseen symbols
05e9fee9
Merge branch 'jicwen/xnnpack_multithreading' of github.com:microsoft/…
09891015
support opstions to disable ort-threadpool
ee0d931e
pranavsharma
commented
on 2022-09-15
revert graph_partitioner.cc
ac3115ec
Merge branch 'main' into jicwen/xnnpack_multithreading
a05c7e81
Revert "support opstions to disable ort-threadpool"
b60590d9
remove related logs
b2172d0f
remove debug-log: Node partitions on different EPs
c3056ecb
for maxpool
5dee9591
RandySheriffH
commented
on 2022-09-15
RandySheriffH
commented
on 2022-09-15
RandySheriffH
commented
on 2022-09-15
RandySheriffH
commented
on 2022-09-15
[solution] make pthreadpool visible to CPU EP
352d1734
Merge branch 'main' into jicwen/xnnpack_multithreading
1f274f12
Revert "[solution] make pthreadpool visible to CPU EP"
e29d84d4
refactor CreateProvider with SessionOptions as pa
d541161f
skottmckay
commented
on 2022-09-16
fix config check error
f0804f9e
Revert "fix config check error"
00502963
Revert "refactor CreateProvider with SessionOptions as pa"
cdd1706d
rename thread_num to intra_op_num_threads
02541dea
simply headers include and minimal changes
f85e93cf
append comment
d7fc9796
skottmckay
commented
on 2022-09-20
skottmckay
dismissed these changes
on 2022-09-20
if statement with init to remove redundant lookup
6c08b3bc
skottmckay
approved these changes
on 2022-09-20
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub