llama.cpp
server: allow to override threads server pool with --threads-http
#5794

Merged

server: allow to override threads server pool with --threads-http #5794

phymbert merged 1 commit into master from feature/server-http-threads

phymbert requested a review from

ggerganov 2 years ago

phymbert requested a review from

ngxson 2 years ago

ngxson commented on 2024-02-29

server: allow to override threads server pool with --threads-http

a55e8fc6

phymbert force pushed from ccad4253 to a55e8fc6 2 years ago

ngxson requested a review from

ngxson 2 years ago

ngxson approved these changes on 2024-02-29

phymbert changed the title ~~server: allow to override threads server pool with --threads-server~~ server: allow to override threads server pool with --threads-http 2 years ago

phymbert merged 5cb02b4a into master 2 years ago

phymbert deleted the feature/server-http-threads branch 2 years ago

Reviewers

ngxson

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

llama.cpp server: allow to override threads server pool with --threads-http #5794 Merged

server: allow to override threads server pool with --threads-http #5794

llama.cpp
server: allow to override threads server pool with --threads-http
#5794

Merged