onnxruntime
Utilize ext data location to reduce qd matmul memory usage
#21451

Merged

Utilize ext data location to reduce qd matmul memory usage #21451

fajin-corp merged 10 commits into main from fajin/dqmatmulmemoryusage

fajin-corp requested a review from

skottmckay 1 year ago

fajin-corp requested a review from

snnn 1 year ago

skottmckay requested a review from

pranavsharma 1 year ago

hack ext data location to reduce qd matmul memory usage

cecf225e

fixing gls::narrow

ae4fffb0

fix linting

d397d577

fix linting

4ac79aae

fajin-corp force pushed from dbc29037 to 4ac79aae 1 year ago

try fixing memory sanitize errro

2a10552a

fixing optional

21f63fbe

fix memory leak when tensor is too small to become external buffer

a6e4ae47

add memory leak guardian and fix linting

5a9d15c8

yufenglee dismissed these changes on 2024-07-30

fajin-corp changed the title ~~hack ext data location to reduce qd matmul memory usage~~ Utilize ext data location to reduce qd matmul memory usage 1 year ago

snnn commented on 2024-07-30

resolve comments

20f6cea7

fajin-corp dismissed their stale review via 20f6cea7 1 year ago

resolve comments

f3a456f7

snnn approved these changes on 2024-07-30

fajin-corp merged e7aa1160 into main 1 year ago

fajin-corp deleted the fajin/dqmatmulmemoryusage branch 1 year ago

fajin-corp added release:1.19.0

prathikr added cherry-picked

Reviewers

snnn

yufenglee

skottmckay

pranavsharma

Assignees

No one assigned

Labels

cherry-picked release:1.19.0

Milestone

No milestone

onnxruntime Utilize ext data location to reduce qd matmul memory usage #21451 Merged

Utilize ext data location to reduce qd matmul memory usage #21451

onnxruntime
Utilize ext data location to reduce qd matmul memory usage
#21451

Merged