llama.cpp
24e41838 - ggml-cuda: assign four GDN state columns per warp (#30087)

Commit
41 days ago
ggml-cuda: assign four GDN state columns per warp (#30087) * ggml-cuda: assign two GDN state columns per warp * ggml-cuda: use 4 GDN state columns per warp at S_v=128 * ggml-cuda: default cols_per_warp=4 * ggml-cuda: address GDN review nits
Author
Parents
Loading