llama.cpp
5e6229a8 - common : fix double bos, use common_chat_templates for add_bos and add_eos (#15326)

Commit
55 days ago
common : fix double bos, use common_chat_templates for add_bos and add_eos (#15326) This commit updates common_chat_templates_apply_jinja to use the the add_bos and add_eos parameters from the chat template instead of the inputs. The motivation for this is that currently if the `add_bos` and `add_eos` from the input parameters are used it is possible to there will be a missmatch between the model and the chat template which can lead to the the removal of duplicate BOS/EOS tokens in chat.cpp `apply` to not happen leading to two BOS tokens being added to the template.
Author
Parents
Loading