onnxruntime
e858164c - Add group size 6 support to paged XQA (#32108)

Commit
92 days ago
Add group size 6 support to paged XQA (#32108) Enable the optimized xqa decode kernel for group size 6 when there are 6 kv heads per query
Author
Parents
Loading