onnxruntime
d1bd6a98 - fix(attention): correct grouped-query caches

Commit
57 days ago
fix(attention): correct grouped-query caches This commit addresses feedback by refining KV transposes, ensuring correct shared cache handling, validating 4-D K/V tensors, and ensuring robust regression testing.
Author
Committer
Parents
Loading