llama.cpp
5b1248c9 - server : Cmdline arg -to changes http read timeout from current 600sec default (#18279)

Commit
3 days ago
server : Cmdline arg -to changes http read timeout from current 600sec default (#18279) * Prevent crash if TTFT >300sec, boosted to 90 days * server : allow configurable HTTP timeouts for child models * server : pass needed timeouts from params only --------- Co-authored-by: Greg Slocum <fromgit@wbtek.slocum.net>
Author
Parents
Loading