llama.cpp
75422e8b
- graph : normalize Q, K, V shapes + sync cross attention (#12449)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
271 days ago
graph : normalize Q, K, V shapes + sync cross attention (#12449) * graph : normalize Q, K, V shapes and add comments ggml-ci * context : synchronize before getting cross attention data * model : fix command-r attention norm check
References
#12449 - graph : normalize Q, K, V shapes and add comments
Author
ggerganov
Parents
bb115d2b
Loading