llama.cpp
server: --n-predict option document and ensure the completion request does not exceed it
#5549
Merged
Merged
server: --n-predict option document and ensure the completion request does not exceed it #5549
ggerganov
merged
3 commits into
ggml-org:master
from
phymbert:feature/server-global-n-predict
server: document --n-predict
cf7137e8
server: ensure client request cannot override n_predict if set
8852de34
phymbert
changed the title
server: fix print usage LF in new --n-predict option
d1124575
phymbert
commented
on 2024-02-17
ggerganov
approved these changes
on 2024-02-18
Login to write a write a comment.
Login via GitHub