llama.cpp
server: init server http requests threads pool with --parallel if set
#5836
Merged
Merged
server: init server http requests threads pool with --parallel if set #5836
ggerganov
merged
1 commit into
master
from
feature/server/init-http-threads-with-n-slots
server: init server http requests threads pool with max of hardware_c…
65e013b6
ggerganov
approved these changes
on 2024-03-03
Login to write a write a comment.
Login via GitHub