llama.cpp

dd6e6d0b - vocab : prevent tokenizer overflow (#14301)

vocab : prevent tokenizer overflow (#14301) * vocab : prevent stack overflow in tokenize * vocab : return error instead of aborting on oversized token count * vocab : INT32_MIN from llama_tokenize on overflow