llama.cpp
faf69d42
- llama : sanitize invalid tokens (#9357)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
llama : sanitize invalid tokens (#9357) * common : do not add null tokens during warmup ggml-ci * llama : check that the input tokens are valid ggml-ci * tests : fix batch size of bert model ggml-ci
References
#9357 - llama : sanitize invalid tokens
Author
ggerganov
Parents
e536426d
Loading