onnxruntime
8eb49c5f
- fix gqa rotary dim 1 (#19874)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
fix gqa rotary dim 1 (#19874) ### Description GQA Rotary Dimension 1 incorrectly assumed to be based on head size. ### Motivation and Context This change should enable us to run phi-2 with GQA and Rotary Embedding fused.
References
#19874 - fix gqa rotary dim 1
Author
aciddelgado
Parents
e771a763
Loading