onnxruntime
Introduce reused_buffer_index_per_stream in allocation planner which will be reset after computing the reuse buffer for each stream
#19515

Merged

Commits

Compute reuse count only once and do not clear during every stream

jslhcl committed 2 years ago
DONOT decrease use count for the reused buffer if it is already 0

jslhcl committed 2 years ago
reset reused_buffer_index every time computing next stream's reuse plan

Lei Cao committed 2 years ago
introduce reused_buffer_index_per_stream

jslhcl committed 2 years ago
Merge branch 'leca/experiment' of https://github.com/microsoft/onnxruntime into leca/experiment

jslhcl committed 2 years ago
undo previous commit for the changes on reused_buffer_index

jslhcl committed 2 years ago
add test case

Lei Cao committed 2 years ago
fix comments

jslhcl committed 2 years ago
fix lint

jslhcl committed 2 years ago
reset lint

jslhcl committed 2 years ago