llama.cpp

68ee98ae - server : return HTTP 400 if prompt exceeds context length (#16486)

server : return HTTP 400 if prompt exceeds context length (#16486) In streaming mode when prompt exceeds context length, the server returns HTTP 200 status code with a JSON error in the body. This is very confusing and inconsistent with all other inference engines which return HTTP 4xx error in this case. This patch fixes this problem and makes the server return HTTP 400 in such cases.