microsoft/onnxruntime

Pull Requests Commits

Update workspace benchmarks with WDDM peaks

chilo-ms committed 3 hours ago

8eff833d

Add WDDM process memory sampling

chilo-ms committed 4 hours ago

0913e1b1

Add local CUDA workspace benchmarks

chilo-ms committed 6 hours ago

442c1b64

Test CUDA arena savings from planned workspace

chilo-ms committed 5 days ago

f4e45cbc

Avoid workspace declaration for MatMulNBits GEMV

chilo-ms committed 5 days ago

b5236e8e

Bridge planned workspace access to CUDA

chilo-ms committed 5 days ago

01165aab

Test planned workspace across MatMulNBits chain

chilo-ms committed 5 days ago

84409b97

Plan CUDA workspace with activations

chilo-ms committed 5 days ago

f867bdde

Preallocate declared CUDA workspace

chilo-ms committed 5 days ago

30da4dd0

Verify Level-2 workspace reservations

chilo-ms committed 5 days ago

1948ce23

Fix CUDA plugin config key compilation

chilo-ms committed 6 days ago

a0932465

Clarify Level-1 prepack memory accounting

chilo-ms committed 6 days ago

8a78fb2c

Align CUDA memory estimation with session config

chilo-ms committed 7 days ago

d3cff998

Account for MatMulNBits tactic profiler scratch

chilo-ms committed 7 days ago

5d7d98e2

Clarify Level-1 initialization accounting contract

chilo-ms committed 7 days ago

00d62c9b

Avoid double-counting offline-prepacked GPU weights

chilo-ms committed 7 days ago

44d524ea

Avoid GCC optional initialization warning

chilo-ms committed 8 days ago

2c33db55

Address workspace accounting review feedback

chilo-ms committed 8 days ago

79248e39

Preserve partial profile accounting behavior

chilo-ms committed 8 days ago

a2c9de7e

Account for MatMulNBits prepack memory

chilo-ms committed 11 days ago

661940ae

Report workspace estimate discrepancies

chilo-ms committed 13 days ago

e9e0e3d4

Unify workspace selection state

chilo-ms committed 14 days ago

da899f32

Resolve workspace estimate with resource cost

chilo-ms committed 15 days ago

c8068bce

Clarify initial resource cost calculation

chilo-ms committed 15 days ago

edbd5755

Document pending resource accounting state

chilo-ms committed 15 days ago

6dbbd9b0

Rename size-based resource accountant

chilo-ms committed 15 days ago

a5af386b

Combine profiled and estimated workspace accounting

chilo-ms committed 15 days ago

37560cf0

Report committed workspace estimates after graph partitioning

chilo-ms committed 15 days ago

3afd9306

Wire max-shape inference into workspace estimation (#31613)

chilo-ms committed 15 days ago

Verified 808ba88b

Weightless support for all initializers (#29607)

chilo-ms committed 15 days ago

Verified 53211cd3

Older