openvino
d2f4173e - [NPU][WS] Remove the references towards original weights sooner during init execution (#34072)

Commit
68 days ago
[NPU][WS] Remove the references towards original weights sooner during init execution (#34072) ### Details: - This is an optimization that should decrease the memory consumed by the execution of the init schedules. - Note that, since in these changes we are freeing `shared_ptr` objects sooner, the benefit of this optimization can be observed only if the NPU plugin was the only component to hold the original weights pointers. Therefore, in cases such as the compilation flow, we don't expect to see any impact (the user holds a pointer towards the model, and implictly all original weights). But there might be an impact on the import flow, if the `weights_path` config option is used. Atm, no meaningful measurements have been taken. --------- Co-authored-by: Golubev, Andrey <andrey.golubev@intel.com>
Parents
Loading