llama.cpp
Add pre-tokenizer regexes for BLOOM and gpt3-finnish
#8850
Merged
Overview
Commits
1
Changes
View On GitHub

Add pre-tokenizer regexes for BLOOM and gpt3-finnish #8850

ggerganov merged 1 commit into ggml-org:master from Exploder98:bloom-pre-tokenizer
Exploder98
Exploder98 Add pre-tokenizer regexes for BLOOM and gpt3-finnish
409406dc
github-actions github-actions added python
ggerganov
ggerganov approved these changes on 2024-08-04
mofosyne mofosyne added Review Complexity : Low
mofosyne mofosyne added merge ready
mofosyne mofosyne added bugfix
Exploder98
ggerganov ggerganov merged 6bda7ce6 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
bugfix Review Complexity : Low python merge ready
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum