llama.cpp
f56d6077
- Add byte token type when tokenizer.model is not exists (#4641)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Add byte token type when tokenizer.model is not exists (#4641) * Add byte token type to hf format * remove unused variable
References
#4641 - Add byte token type when tokenizer.model is not exists
Author
strutive07
Parents
dc68f005
Loading