llama.cpp
91eaa414 - unicode : support \p{N}, \p{L} and \p{P} natively

Commit

1 year ago

unicode : support \p{N}, \p{L} and \p{P} natively

References

#6920 - llama : improve BPE pre-processing + LLaMA 3 and Deepseek support

Author

ggerganov

ggerganov

Parents

Loading