llama.cpp
server: re-design yield_to_queue thread model
#27133
Merged

server: re-design yield_to_queue thread model #27133

ngxson merged 2 commits into master from xsn/fix_yield_to_queue
ngxson
ngxson run common_speculative_process in worker
51a4f630
ngxson swap worker <--> main thread design
9871d51f
ngxson ngxson requested a review 64 days ago
ngxson
github-actions github-actions added server
fairydreaming
ServeurpersoCom
ServeurpersoCom approved these changes on 2026-08-15
ngxson ngxson merged 22b8e310 into master 64 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone