llama.cpp

889bdd76 - command-r : add BPE pre-tokenization (#7063)

command-r : add BPE pre-tokenization (#7063) * Add BPE pre-tokenization for Command-R/R+. * Bump transformers convert requirement. * command-r : add individual digits regex --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>