llama.cpp
5aeac37a
- ggml-cuda: fattn do not check oob if k_VKQ_max = (k_VKQ_max - nbatch_fa) (#30572)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
7 days ago
ggml-cuda: fattn do not check oob if k_VKQ_max = (k_VKQ_max - nbatch_fa) (#30572)
References
#30572 - ggml-cuda: fattn do not check oob if k_VKQ_0 = (k_VKQ_max - nbatch_fa)
Author
thelittlefireman
Parents
547208dc
Loading