llama.cpp
40f3aafc - server: add "X-Accel-Buffering": "no" header to streaming endpoints (#24774)

Commit
21 days ago
server: add "X-Accel-Buffering": "no" header to streaming endpoints (#24774) * server: add "X-Accel-Buffering": "no" header to streaming endpoints This header tells Nginx (as a reverse proxy) to NOT buffer responses. (only affects streaming endpoints) Without it, Nginx will break streaming with certain applications (notably the Pi coding harness).
Author
Parents
Loading