onnxruntime
e858164c
- Add group size 6 support to paged XQA (#32108)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
92 days ago
Add group size 6 support to paged XQA (#32108) Enable the optimized xqa decode kernel for group size 6 when there are 6 kv heads per query
References
#32108 - Add group size 6 support to paged XQA
Author
baijumeswani
Parents
d4d792f5
Loading