llama.cpp
59ce8531
- test-tokenizer-random : reduce potential confilcts with #8379
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
test-tokenizer-random : reduce potential confilcts with #8379 * test-tokenizer-random : add a failing edge case for falcon
References
compilade/fix-mpt-pretok
#8228 - llama : fix pre-tokenization of non-special added tokens
Author
compilade
Committer
compilade
Parents
1caa20fc
Loading