llama.cpp
24e41838
- ggml-cuda: assign four GDN state columns per warp (#30087)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
41 days ago
ggml-cuda: assign four GDN state columns per warp (#30087) * ggml-cuda: assign two GDN state columns per warp * ggml-cuda: use 4 GDN state columns per warp at S_v=128 * ggml-cuda: default cols_per_warp=4 * ggml-cuda: address GDN review nits
References
#30087 - ggml-cuda: assign four GDN state columns per warp
Author
SongXiaoXi
Parents
847f447c
Loading