llama.cpp
7a389564 - allow server to multithread

Commit
2 years ago
allow server to multithread because web browsers send a lot of garbage requests we want the server to multithread when serving 404s for favicon's etc. To avoid blowing up llama we just take a mutex when it's invoked.
Author
Committer
Parents
Loading