llama.cpp
095058ca
- add arg --threads-sampling
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
29 days ago
add arg --threads-sampling
References
xsn/server_multithread_sampling
#24914 - server: run sampling in a threadpool
Author
ngxson
Parents
c62fdd5f
Loading