onnxruntime
10ea381c - [WebGPU] Enable GeluFusion and BiasGeluFusion for the WebGPU EP (#32053)

Commit
5 days ago
[WebGPU] Enable GeluFusion and BiasGeluFusion for the WebGPU EP (#32053) ### Description Add a new EP allowlist that includes WebGPU (`cpu_acl_cuda_dml_webgpu_eps`), and use it for the Level-2 `GeluFusion` and `BiasGeluFusion` transformers. This allows the erf-based GELU pattern (`Div` -> `Erf` -> `Add` -> `Mul` -> `Mul`, optionally preceded by a bias Add) to fuse into the WebGPU EP's kMSDomain Gelu and BiasGelu kernels instead of running as separate elementwise dispatches. This covers models using older opsets that the opset >= 20 Level-1 `GeluFusion` transformer does not handle. ### Performance Impact In native WebGPU build, the vision submodel of zero-shot image classification achieved a 1.11x wall-clock speedup on Panther Lake and a 1.15x speedup on Wildcat Lake. | Platform | Latency reduction | Speedup | |--------------------------|-------------------|---------| | Intel Wildcat Lake (WCL) | −13.0% | 1.15× | | Intel Panther Lake (PTL) | −9.9% | 1.11× | This PR addresses the `Gelu` and `BiasGelu` items listed in [#29841](https://github.com/microsoft/onnxruntime/issues/29841). --------- Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Author
Parents
Loading