onnxruntime
dc876910 - Enable DML graph fusion independently of graph optimization level (#15172)

Commit
3 years ago
Enable DML graph fusion independently of graph optimization level (#15172) ### Description Apply the DML graph fusion transformer optimization independently of ORT graph optimization level. ### Motivation and Context The DML graph fusion transformer is not a graph optimizer in the normal sense: it isn't optimizing the ONNX graph structure, but rather fusing nodes into what will later become a single IDMLCompiledOperator (using IDMLDevice1::CompileGraph). This transformer can't be done ahead of time (hence why it's disabled if saving an optimized model), but it's also gated by the ORT graph optimization level; this makes it impossible to preoptimize ONNX models ("offline mode") and then later disable graph optimizations for better startup performance ("online mode") while benefiting from DML graph fusion.
Author
Parents
Loading