llama.cpp
Add BPE pre-tokenization for Command-R/R+.
#7063
Merged
Overview
Commits
3
Changes
View On GitHub

Add BPE pre-tokenization for Command-R/R+. #7063

ggerganov merged 3 commits into ggml-org:master from dranger003:bpe-pretok-command-r-2
dranger003
github-actions
slaren
dranger003
araleza
eskeletor97
ggerganov
ggerganov
dranger003 Add BPE pre-tokenization for Command-R/R+.
d5d67316
dranger003 dranger003 force pushed from 7bfc01b2 to d5d67316 1 year ago
dranger003 Bump transformers convert requirement.
20157cfd
dranger003
ggerganov command-r : add individual digits regex
f5806b2d
ggerganov ggerganov merged 889bdd76 into master 1 year ago
dranger003 dranger003 deleted the bpe-pretok-command-r-2 branch 308 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum