onnxruntime
Introduce reused_buffer_index_per_stream in allocation planner which will be reset after computing the reuse buffer for each stream
#19515

Merged

Introduce reused_buffer_index_per_stream in allocation planner which will be reset after computing the reuse buffer for each stream #19515

jslhcl merged 10 commits into main from leca/experiment

Compute reuse count only once and do not clear during every stream

0c9d031a

DONOT decrease use count for the reused buffer if it is already 0

20734bac

reset reused_buffer_index every time computing next stream's reuse plan

52c28b80

introduce reused_buffer_index_per_stream

02b7043b

Merge branch 'leca/experiment' of https://github.com/microsoft/onnxru…

18a1532c

undo previous commit for the changes on reused_buffer_index

e99a8cd5

jslhcl requested a review from

souptc 2 years ago

jslhcl changed the title ~~[DONT Review] Compute reuse count only once and do not clear during every stream~~ Introduce reused_buffer_index_per_stream in allocation planner which will be reset after computing the reuse buffer for each stream 2 years ago

jslhcl requested a review from

PatriceVignola 2 years ago

add test case

8262d0b4

jslhcl marked this pull request as ready for review 2 years ago

fix comments

3e50a00c

souptc dismissed these changes on 2024-02-20

fix lint

45747fd4

jslhcl dismissed their stale review via 45747fd4 2 years ago

PatriceVignola dismissed these changes on 2024-02-21

reset lint

16507c33

jslhcl dismissed their stale review via 16507c33 2 years ago

PatriceVignola approved these changes on 2024-02-22

jslhcl merged 6b73ab3e into main 2 years ago

jslhcl deleted the leca/experiment branch 2 years ago

Reviewers

PatriceVignola

souptc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

onnxruntime Introduce reused_buffer_index_per_stream in allocation planner which will be reset after computing the reuse buffer for each stream #19515 Merged

Introduce reused_buffer_index_per_stream in allocation planner which will be reset after computing the reuse buffer for each stream #19515

onnxruntime
Introduce reused_buffer_index_per_stream in allocation planner which will be reset after computing the reuse buffer for each stream
#19515

Merged