llama.cpp
f56d6077 - Add byte token type when tokenizer.model is not exists (#4641)

Commit
2 years ago
Add byte token type when tokenizer.model is not exists (#4641) * Add byte token type to hf format * remove unused variable
Author
Parents
Loading