llama.cpp
Cmdline arg -to changes http read timeout from current 600sec default
#18279

Merged

Cmdline arg -to changes http read timeout from current 600sec default #18279

ngxson merged 3 commits into ggml-org:master from wbtek:wbtek/server-timeout-extension

Prevent crash if TTFT >300sec, boosted to 90 days

25267f83

wbtek requested a review from

ngxson 22 days ago

wbtek requested a review from

ggerganov 22 days ago

github-actions added examples

github-actions added server

ngxson commented on 2025-12-22

ngxson requested changes on 2025-12-22

server : allow configurable HTTP timeouts for child models

39c2038b

ngxson requested changes on 2025-12-22

server : pass needed timeouts from params only

5c037f56

wbtek force pushed from d49cd26a to 5c037f56 21 days ago

wbtek requested a review from

ngxson 20 days ago

wbtek changed the title ~~Prevent crash if TTFT >300sec, boosted to 90 days~~ Prevent http fail if LLM doesn't respond in 300sec, use timeout (-to) cmdline arg to extend timeout 20 days ago

wbtek changed the title ~~Prevent http fail if LLM doesn't respond in 300sec, use timeout (-to) cmdline arg to extend timeout~~ Use -to cmdline arg to extend http timeout if LLM doesn't respond within default 300sec (now 600sec) 20 days ago

wbtek changed the title ~~Use -to cmdline arg to extend http timeout if LLM doesn't respond within default 300sec (now 600sec)~~ Use -to cmdline arg to extend http read timeout. Default now 600sec, was 300 20 days ago

wbtek changed the title ~~Use -to cmdline arg to extend http read timeout. Default now 600sec, was 300~~ Cmdline arg -to changes http read timeout from current 600sec default 20 days ago

ngxson approved these changes on 2025-12-29

ngxson merged 5b1248c9 into master 14 days ago

wbtek deleted the wbtek/server-timeout-extension branch 7 days ago

Reviewers

ngxson

ggerganov

Assignees

No one assigned

Labels

examples server

Milestone

No milestone

llama.cpp Cmdline arg -to changes http read timeout from current 600sec default #18279 Merged

Cmdline arg -to changes http read timeout from current 600sec default #18279

llama.cpp
Cmdline arg -to changes http read timeout from current 600sec default
#18279

Merged