onnxruntime
4dc4470c - Fix fusion for two LayerNorm sharing same input but with different weights (#15919)

Commit
2 years ago
Fix fusion for two LayerNorm sharing same input but with different weights (#15919) in gpt_j_residual(https://arxiv.org/pdf/2204.06745.pdf), there are 2 LN nodes will share one same input, and ORT does CSE graph optimization before LN fusion, which will modify the LN graph pattern and thus make LN fusion failure. ![image](https://github.com/microsoft/onnxruntime/assets/10530022/40990fd6-796f-4edf-be0b-3203e8503678)
Author
Parents
Loading