llama.cpp
0c06204f - main : add `--in-prefix-bos` to prefix BOS to user inputs; keep EOS (#2304)

Commit
3 years ago
main : add `--in-prefix-bos` to prefix BOS to user inputs; keep EOS (#2304) * add `--in-prefix-bos` to prefix BOS to user inputs; keep EOS The BOS precedes the string specified by `--in-prefix`. Model generated EOS is now kept in the context. It provides a way to strictly following the prompt format used in Llama-2-chat. The EOS handling also benefits some existing finetunes that uses EOS to mark the end of turn. * examples/common: move input_prefix_bos to other bools
Author
jxy jxy
Parents
Loading