openvino
10801e65 - [Plugin batch] BatchMode::PLUGIN shouldn't send a model to the compiler if we failed to process it in the plugin (#34041)

Commit
71 days ago
[Plugin batch] BatchMode::PLUGIN shouldn't send a model to the compiler if we failed to process it in the plugin (#34041) ### Details: If we set the batch mode to `BatchMode::PLUGIN` and send it to the plugin, but it fails because not all I/O operations have the same dimension, we will only get the log information and leave `BatchMode::PLUGIN` and send it to the compiler. Expected behavior: throw an exception in this particular case and do not send the `BatchMode::PLUGIN` to the compiler at all. Note: Providing layouts for inputs/outputs is necessary for plugin batching to be applied correctly.
Parents
Loading