onnxruntime
f80e6f41 - Enable VTCM Back Up Buffer Sharing (#24962)

Commit
1 year ago
Enable VTCM Back Up Buffer Sharing (#24962) ### Description Enabling the VTCM backup buffering feature on QNN EP, assuming all graphs are running sequentially where the input of the next graph is the output of the current graph. Under these assumptions, rather than allocate buffers for all inputs and outputs, only a single buffer can be shared between all graphs. ### Motivation and Context This will allow larger LLM models to be run
Author
Parents
Loading