onnxruntime
[TRT RTX EP] EP context changes
#25747
Merged
Overview
Commits
25
Changes
View On GitHub

[TRT RTX EP] EP context changes #25747

chilo-ms merged 25 commits into microsoft:main from thevishalagarwal:ep-ctx-weights
thevishalagarwal
gedoensmax
thevishalagarwal
gedoensmax
gedoensmax commented on 2025-08-14
gedoensmax
gedoensmax
gedoensmax commented on 2025-08-14
chilo-ms
azure-pipelines
yuslepukhin
yuslepukhin commented on 2025-08-15
yuslepukhin
yuslepukhin commented on 2025-08-15
jywu-msft jywu-msft added ep:NvRTX
jywu-msft jywu-msft requested a review from HectorSVC HectorSVC 271 days ago
jywu-msft jywu-msft requested a review from chilo-ms chilo-ms 271 days ago
chilo-ms
azure-pipelines
chilo-ms
chilo-ms commented on 2025-08-20
thevishalagarwal implement GetEPContextNodes()
d9878a3b
thevishalagarwal clean up
bde3ce56
thevishalagarwal rebase to latest
7165dfe3
thevishalagarwal remove ctx model to just add node
7b1f5bc9
thevishalagarwal update GetCapabilities for multiple EP Context Nodes
03c42fd3
thevishalagarwal fix lint
43ac5d51
thevishalagarwal add support for TRT external weights API
313f4cea
thevishalagarwal add new changes
a7eadab6
thevishalagarwal update external initializer fix
23c63938
thevishalagarwal fix EP name
7b1320ee
gedoensmax reorganize unittest helpers
3b039fa7
gedoensmax fix type tests
28d211e6
gedoensmax basic EP context support
bd3d4edf
gedoensmax large model test
d5151d73
gedoensmax remove support for weightless
8de13f9b
gedoensmax reduce header usages, cleanup and unify usage of windows ifdef
e2b67a4e
gedoensmax address review comments
3728ce0c
thevishalagarwal fix engine cache path with EP context
80574d29
thevishalagarwal fix unit test to add seed for random tensors
3996d9b5
thevishalagarwal support sm86 and onwards RTX devices
a4f8c454
thevishalagarwal update cc check
b0bab1c1
thevishalagarwal fix lint
f762d860
gedoensmax do not copy memory to EP owned memory for raw initializers
b81a6d54
gedoensmax use ort values i data is already loaded in memory
d0926f8a
chilo-ms chilo-ms added release:1.23.0
gedoensmax gedoensmax force pushed from ef8540a6 to d0926f8a 269 days ago
gedoensmax remove unused var
f6404304
thevishalagarwal thevishalagarwal requested a review from chilo-ms chilo-ms 269 days ago
thevishalagarwal thevishalagarwal requested a review from yuslepukhin yuslepukhin 269 days ago
gedoensmax
chilo-ms
azure-pipelines
chilo-ms
chilo-ms commented on 2025-08-21
chilo-ms
chilo-ms approved these changes on 2025-08-21
chilo-ms chilo-ms merged 8d8a82ba into main 268 days ago
jywu-msft jywu-msft removed release:1.23.0

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ep:NvRTX
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum