onnxruntime
a561fde1 - MIGraphX Execution Provider: Stream Synchronization (#12899)

Commit
3 years ago
MIGraphX Execution Provider: Stream Synchronization (#12899) **Description**: Changes to the MIGraphx execution provider code to allow for stream synchronization on the gpu side **Motivation and Context** Performance boost by removing redundant host to device synchronizations The current implementation of the execution provider continuously calls hipDeviceSynchronize() between computations which adds overhead and an idle wait between the GPU's computations. This is noticeable during device This change leverages new functionality that's been added to MIGraphX to allow for GPU side synchronization which avoids the need for host->device waits. To maintain backwards compatibility with older MIGraphX versions, the compile time define MIGRAPHX_STREAM_SYNC has been added to the API to allow for older version operate with newer builds of onnxruntime without loss of functionality to the current feature set as of (08/09/22) Co-authored-by: Ted Themistokleous <tthemist@amd.com>
Parents
Loading