llama.cpp
Tokenizer SPM fixes for phi-3 and llama-spm (bugfix)
#7425

Merged

Commits

Style

jaime-m-p committed 1 year ago
Update brute force test: add_special

jaime-m-p committed 1 year ago
Enable rtrim when pre-inserting BOS

jaime-m-p committed 1 year ago
Default values for add_bos_token and add_eos_token

jaime-m-p committed 1 year ago
Revert "server : fix test regexes"

ggerganov committed 1 year ago