llama.cpp

d4c8e2c2 - vocab : add tokenizer support for jina-embeddings-v2-base-zh (#18756)

vocab : add tokenizer support for jina-embeddings-v2-base-zh (#18756) * vocab : add jina-embeddings-v2-base-zh (whitespace tokenizer) * lowercase defaults to true * type fix --------- Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>