llama.cpp
server: stop generation at `n_ctx_train` if `n_predict` is not set
#6638
Merged
Merged
server: stop generation at `n_ctx_train` if `n_predict` is not set #6638
phymbert
merged
7 commits into
master
from
hp/server/avoid-infinite-loop
server: cap n_predict if not set to n_ctx_train
6fd5ad59
Merge remote-tracking branch 'refs/remotes/origin/master' into hp/ser…
558f6908
server: fix infinite loop
5d64ffd8
phymbert
changed the title
phymbert
changed the title
server: infinite loop, move in process_token
1423fcec
minor: spaces
03f458c6
slaren
approved these changes
on 2024-04-19
phymbert
commented
on 2024-04-19
minor: spaces
0d3eca69
server: include prompt tokens in the EOS limit
6c257f47
ggerganov
approved these changes
on 2024-04-26
Login to write a write a comment.
Login via GitHub