openvino
1b821af2 - [OV][ITT] Adds support for async inferences and default NPU markers (#34279)

Commit
44 days ago
[OV][ITT] Adds support for async inferences and default NPU markers (#34279) ### Details: #Feature enhancement - Part 2 This PR is the second of this series of PRs to standardize the ITT markers in OpenVINO that will be enabled by default through host-side instrumentation. -The first PR# [34278](https://github.com/openvinotoolkit/openvino/pull/34278) addresses the standardization of Read/Compiler phases of the runtime to use the new domain names - This second PR adds support for asynchronous inference requests by extending the ITT marker support to accept metadata that will help correlate asynchronous markers with the help of a thread-safe generated inference ID. - This PR also extends the same host side markers for NPU execution, which captures the inference span and pipeline activity with the help of the extensions. ### Tickets: - [CVS-179230](https://jira.devtools.intel.com/browse/CVS-179230) ### AI Assistance: - *AI assistance used: no* --------- Signed-off-by: Vasanth Tovinkere <vasanth.tovinkere@intel.com> Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
Author
Parents
Loading