onnxruntime
a7bf093e - [TRT RTX EP] Fixing the stream parameter in CopyTensors API and passing cudastream by value in createNotification API (#25937)

Commit
105 days ago
[TRT RTX EP] Fixing the stream parameter in CopyTensors API and passing cudastream by value in createNotification API (#25937) Fixing the stream parameter in CopyTensors API and passing cudastream by value in createNotification API ### Description <!-- Describe your changes. --> Fixing the stream parameter in CopyTensors API to pass the application passed stream instead of nullptr Passing cudastream by value in createNotification API as passing pointer was leading to dangling reference issues. Can you please make sure that this goes into 1.23? @chilo-ms ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> - Without this code, copy tensors always happens synchronously even when app specifies a different stream to it. - Passing pointer for cudastream in EP API is leading to dangling reference issues, hence switched to passing value.
Author
Parents
Loading