llama.cpp
convert : handle tokenizer merges format from transformers 4.45
#9696
Merged
Merged
convert : handle tokenizer merges format from transformers 4.45 #9696
ggerganov
merged
2 commits into
master
from
compilade/convert-merges-pairs-to-old
convert : handle tokenizer merges format from transformers 4.45
8ba38584
ggerganov
approved these changes
on 2024-09-30
Vaibhavs10
commented
on 2024-09-30
Merge branch 'master' into compilade/convert-merges-pairs-to-old
a38fc04f
pcuenca
approved these changes
on 2024-09-30
xmaayy
approved these changes
on 2024-10-02
Reviewers
Assignees
No one assigned
Labels
bugfix
Review Complexity : Low
python
merge ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub