onnxruntime
d5f022a3 - Recover Conv/ConvTranspose rank from weight when input shape is unknown (#29149)

Commit
105 days ago
Recover Conv/ConvTranspose rank from weight when input shape is unknown (#29149) Recover Conv/ConvTranspose rank from weight when input shape is unknown, enabling layout transformation to NHWC for more nodes. ### Description The layout transformer skips converting a node to NHWC when input[0] has no inferred shape. For Conv and ConvTranspose operators, the data input (input[0]) and the weight (input[1]) always share the same rank. When the input rank is unknown, recover it from the weight. ### Performance Impact Measured on Kokoro-82M-v1.0-ONNX text-to-speech model ([onnx-community/Kokoro-82M-v1.0-ONNX](https://huggingface.co/onnx-community/Kokoro-82M-v1.0-ONNX)) with WebGPU ep, | Platform | Latency reduction | Speedup | |:------------------:|:-----------------:|:-------:| | Intel Wildcat Lake | −32.0% | 1.47× | | Intel Panther Lake | −20.0% | 1.25× | This change yields a 1.2–1.5× speedup on the Kokoro-82M text-to-speech model. --------- Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Author
Parents
Loading