onnxruntime
276918d9
- Allow SkipLayerNorm and LayerNorm in rotary attention fusion (#18288)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Allow SkipLayerNorm and LayerNorm in rotary attention fusion (#18288) Although SimplifiedLayerNorm is faster than LayerNorm, DML doesn't have an optimized implementation for the former yet and LayerNorm ends up being faster.
References
#18288 - Allow SkipLayerNorm and LayerNorm in rotary attention fusion
Author
PatriceVignola
Parents
fb6737e8
Loading