onnxruntime
a0cc289b - Update SkipLayerNorm fusion rules (#13350)

Commit
3 years ago
Update SkipLayerNorm fusion rules (#13350) ### Description <!-- Describe your changes. --> The subgraph below meet the SkipLayerNorm fusion pattern, but the fusion rules also required every input dimension has a certain value. So the subgraph below cannot fused to SkipLayerNorm. subgraph we want to fuse ![image](https://user-images.githubusercontent.com/94887879/196386821-3e678a4c-83e4-4bca-8900-5ef4ea996868.png) fusion pattern 3 [Sub1] [Sub2] \ / \ / \ / Add1 | LayerNormalization This change allow inputs of FirstAdd operator has dimension which only has dim_param. ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> Co-authored-by: peixuanzuo <peixuanzuo@linmif39a000004.zvflicr54joexhdgnhvmxrxygg.phxx.internal.cloudapp.net>
Author
Parents
Loading