llama.cpp
Add BPE pre-tokenization for DBRX.
#7132
Merged
Overview
Commits
4
Changes
View On GitHub

Add BPE pre-tokenization for DBRX. #7132

ggerganov merged 4 commits into ggml-org:master from dranger003:bpe-dbrx
dranger003
dranger003 Add BPE pre-tokenization for DBRX.
18e447dd
dranger003 Add vocab GGUFs.
48605e20
github-actions
ggerganov
ggerganov
ggerganov approved these changes on 2024-05-08
dranger003 Remove test.
2a87d5ed
dranger003 Remove GGUFs.
6c90dda0
ggerganov
ggerganov approved these changes on 2024-05-08
ggerganov ggerganov merged 4cd621c2 into master 1 year ago
dranger003 dranger003 deleted the bpe-dbrx branch 348 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum