llama.cpp
e1a1abb7
- ggml-cuda: Allow transpose-free gemmv computation (#26171)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
106 days ago
ggml-cuda: Allow transpose-free gemmv computation (#26171) When matrix's weights are shaped 1xK is leverage a transpose-free computation to use mat_mul_vec_f.
References
#26171 - ggml-cuda: Allow transpose-free gemmv computation
Author
roberteg16
Parents
6b36c230
Loading