llama.cpp
d3dc9dd8 - CUDA: Remove unneded bias/gate dims in fused mmvq (#16858)

Commit
39 days ago
CUDA: Remove unneded bias/gate dims in fused mmvq (#16858) * CUDA: Remove unneded bias/gate dims in fused mmvq Pointed out [here](https://github.com/ggml-org/llama.cpp/pull/16847#discussion_r2476798989) that only a single value is needed per target col per thread * Apply suggestions from code review Co-authored-by: Johannes Gäßler <johannesg@5d6.de> * Fix "Error 991-D: extra braces are nonstandard" during compilation --------- Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
Author
Parents
Loading