onnxruntime
9e79b367 - Add support to filter_ep_devices using ep or device metadata in perftest (#26255)

Commit
65 days ago
Add support to filter_ep_devices using ep or device metadata in perftest (#26255) Add support for ep device selection in ORT perf test by filtering the ep device list based on EP or Device metadata `--filter_ep_devices` (Specifies EP or Device metadata entries as key-value pairs to filter ep devices passed to AppendExecutionProvider_V2. [Usage]: `--filter_ep_devices "<key1>|<value1> <key2>|<value2>"` Devices that match any of the key-value pair will be appended to the session. --select_ep_devices will take precedence over this option. Examples with OpenVINO EP: * `--plugin_ep_libs "OpenVINOExecutionProvider|onnxruntime_providers_openvino_plugin.dll" --plugin_eps OpenVINOExecutionProvider --filter_ep_devices "ov_device|NPU"` `[Plugin EP] EP Device [Index: 1, Name: OpenVINOExecutionProvider, Type: 2] has been added to session.` * `--plugin_ep_libs "OpenVINOExecutionProvider|onnxruntime_providers_openvino_plugin.dll" --plugin_eps OpenVINOExecutionProvider.AUTO --filter_ep_devices "ov_device|NPU ov_device|CPU"` `[Plugin EP] EP Device [Index: 3, Name: OpenVINOExecutionProvider.AUTO, Type: 2] has been added to session.` `[Plugin EP] EP Device [Index: 4, Name: OpenVINOExecutionProvider.AUTO, Type: 0] has been added to session.`
Author
Parents
Loading