PR #7349 Add StableLM2 pre-tokenizer

Add StableLM2 pre-tokenizer #7349

mofosyne merged 3 commits into ggml-org:master from aahouzi:add_stablelm-pre_tokenizer

Add StableLM pre-tokenizer

77474736

Fix space

31219146

mofosyne added model

mofosyne added Review Complexity : Low

ggerganov approved these changes on 2024-05-18

Fix trailing whitespace

ab0910b1

github-actions added python

mofosyne merged 6aade19e into master 2 years ago

aahouzi deleted the add_stablelm-pre_tokenizer branch 2 years ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

model Review Complexity : Low python

Milestone

No milestone