onnxruntime
Add workspace estimation accounting and reporting
#31962
Merged

Add workspace estimation accounting and reporting #31962

chilo-ms merged 35 commits into main from chilo/workspace-estimation-logging
chilo-ms
chilo-ms Report committed workspace estimates after graph partitioning
3afd9306
chilo-ms Combine profiled and estimated workspace accounting
37560cf0
chilo-ms Rename size-based resource accountant
a5af386b
chilo-ms Document pending resource accounting state
6dbbd9b0
chilo-ms Clarify initial resource cost calculation
edbd5755
chilo-ms Resolve workspace estimate with resource cost
c8068bce
chilo-ms Unify workspace selection state
da899f32
chilo-ms Report workspace estimate discrepancies
e9e0e3d4
chilo-ms chilo-ms marked this pull request as ready for review 38 days ago
chilo-ms chilo-ms requested a review from titaiwangms titaiwangms 38 days ago
chilo-ms chilo-ms requested a review from tianleiwu tianleiwu 38 days ago
titaiwangms titaiwangms requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 38 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-08-12
titaiwangms
chilo-ms Account for MatMulNBits prepack memory
661940ae
titaiwangms
chilo-ms Preserve partial profile accounting behavior
a2c9de7e
chilo-ms Address workspace accounting review feedback
79248e39
chilo-ms Avoid GCC optional initialization warning
2c33db55
tianleiwu
tianleiwu requested changes on 2026-08-18
titaiwangms
chilo-ms Avoid double-counting offline-prepacked GPU weights
44d524ea
chilo-ms
chilo-ms Clarify Level-1 initialization accounting contract
00d62c9b
chilo-ms Account for MatMulNBits tactic profiler scratch
5d7d98e2
chilo-ms Align CUDA memory estimation with session config
d3cff998
chilo-ms Clarify Level-1 prepack memory accounting
8a78fb2c
chilo-ms Fix CUDA plugin config key compilation
a0932465
chilo-ms chilo-ms requested a review from tianleiwu tianleiwu 31 days ago
tianleiwu
tianleiwu requested changes on 2026-08-24
chilo-ms Fix workspace accounting edge cases
4a10a1a7
chilo-ms chilo-ms requested a review from tianleiwu tianleiwu 24 days ago
tianleiwu
tianleiwu requested changes on 2026-08-28
chilo-ms Address workspace accounting review feedback
539a10d3
chilo-ms
chilo-ms Merge main into workspace estimation branch
7357ea4d
chilo-ms Fix workspace accounting CI thresholds
fe7048e5
chilo-ms chilo-ms requested a review from tianleiwu tianleiwu 15 days ago
chilo-ms Merge main into workspace estimation branch
8862eb20
tianleiwu
tianleiwu requested changes on 2026-09-04
chilo-ms Fix lazy MatMulNBits profiling accounting
102131fc
chilo-ms Merge latest main after review fix
96132b67
chilo-ms Fix CUDA workspace test namespace
2d192c49
tianleiwu
tianleiwu requested changes on 2026-09-04
chilo-ms Fix bounded MatMulNBits profiling estimates
4471f39d
tianleiwu
tianleiwu requested changes on 2026-09-08
chilo-ms Fix NHWC provisional budget admission
cbf598ca
Clarify initialization scratch estimation
579f2335
Merge main into workspace estimation branch
edf98742
titaiwangms titaiwangms requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 8 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-09-11
Fix NHWC survivor budget retry
5e1a65c8
chilo-ms Reconcile NHWC survivor resource accounting
0ec6f438
Harden NHWC survivor capability reconciliation
c1c4d89b
chilo-ms Fix NHWC overlap resource reconciliation
f848009b
chilo-ms Fix NHWC accounting test node lifetime
644af845
tianleiwu
tianleiwu approved these changes on 2026-09-12
chilo-ms chilo-ms merged 4d95047d into main 6 days ago
chilo-ms chilo-ms deleted the chilo/workspace-estimation-logging branch 6 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone