PR #24914 server: run sampling in a threadpool

server: run sampling in a threadpool #24914

ngxson wants to merge 4 commits into master from xsn/server_multithread_sampling

server: run sampling in a threadpool

fe03cce8

wip

41ed530b

working

c62fdd5f

ngxson requested a review 6 days ago

ngxson changed the title ~~Xsn/server multithread sampling~~ server: run sampling in a threadpool 6 days ago

github-actions added examples

github-actions added server

add arg --threads-sampling

095058ca

ngxson requested a review 6 days ago

ngxson commented on 2026-06-22

ggerganov commented on 2026-06-24

ngxson marked this pull request as draft 3 days ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

examples server

Milestone

No milestone