llama.cpp
d94c6e0c - llama : add support for SmolLm pre-tokenizer (#8609)

Commit
1 year ago
llama : add support for SmolLm pre-tokenizer (#8609) * Adding SmolLM Pre Tokenizer * Update convert_hf_to_gguf_update.py Co-authored-by: compilade <git@compilade.net> * Update src/llama.cpp Co-authored-by: compilade <git@compilade.net> * handle regex * removed .inp and out .out ggufs --------- Co-authored-by: compilade <git@compilade.net>
Author
Parents
Loading