llama.cpp
e1a1abb7 - ggml-cuda: Allow transpose-free gemmv computation (#26171)

Commit
106 days ago
ggml-cuda: Allow transpose-free gemmv computation (#26171) When matrix's weights are shaped 1xK is leverage a transpose-free computation to use mat_mul_vec_f.
Author
Parents
Loading