PR #18263 server: prevent data race from HTTP threads

server: prevent data race from HTTP threads #18263

ngxson merged 14 commits into ggml-org:master from ngxson:xsn/server_data_race

server: prevent data race from HTTP threads

3d64c3bc

ngxson requested a review from

ServeurpersoCom 14 days ago

ngxson requested a review from

ggerganov 14 days ago

github-actions added examples

github-actions added server

fix params

d957b3d1

fix default_generation_settings

7406d683

nits: make handle_completions_impl looks less strange

b0e5ee69

stricter const

c417b6d2

fix GGML_ASSERT(idx < states.size())

db091cd1

move index to be managed by server_response_reader

8124b226

http: make sure req & res lifecycle are tied together

121c7e77

fix compile

ed1f6ad5

fix index handling buggy

1eb29d7d

fix data race for lora endpoint

35a3bc3e

nits: fix shadow variable

982eda7b

nits: revert redundant changes

ab20c9fe

nits: correct naming for json_webui_settings

b1b8098c

ServeurpersoCom approved these changes on 2025-12-22

ngxson merged 6ce863c8 into master 13 days ago

Reviewers

ServeurpersoCom

ggerganov

Assignees

No one assigned

Labels

examples server

Milestone

No milestone

llama.cpp server: prevent data race from HTTP threads #18263 Merged

server: prevent data race from HTTP threads #18263

llama.cpp
server: prevent data race from HTTP threads
#18263

Merged