llama.cpp
31a5cf4c - server: use httplib dynamic threads (#20817)

Commit

20 days ago

server: use httplib dynamic threads (#20817) * server: use httplib dynamic threads * change to n_threads_http + 1024

References

Author

ngxson

Parents