onnxruntime
4eb7f432
- The softmax computation for GQA is not as simple as that of Attention/MHA
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
The softmax computation for GQA is not as simple as that of Attention/MHA
References
#20946 - [JS/WebGPU] GroupQueryAttention rewrite
Author
satyajandhyala
Parents
e85da0a6
Loading