Mirror https://github.com/ggml-org/llama.cpp/pull/22121 #103
use /// instead of // for llama_token_to_piece docstring
74fbcb2b
clarify llama_token_to_piece docstring in analogy to llama_detokenize
72d91803
perform bounds checking on token in token_to_piece
b6387d21
remove always-true conditional
492a14f5
handle INT32_MIN result of llama_token_to_piece in downstream uses
3828da49
add limits includes in files that did not use it before
af7af8ad
add invalid token guard to token_to_piece_for_cache
6b190ab6
propagate token_to_piece failure
0e9b56dd
consistent punctuation
36fe0b03
exit on llama_token_to_piece error
2b00549b
julmb
force pushed
from
16462f45
to
2b00549b
15 days ago
Assignees
No one assigned
Labels
examples
python
testing
Login to write a write a comment.
Login via GitHub