PR #5798 Models without Vocabulary

Models without Vocabulary #5798

ggerganov merged 10 commits into ggml-org:master from Xarbirus:models-without-vocab

cebtenzzre commented on 2024-02-29

ggerganov approved these changes on 2024-03-01

ggerganov requested a review from

cebtenzzre 2 years ago

Xarbirus force pushed 2 years ago

additional methods to read model and ctx parameters

e700b442

vocab size as a part of a model metadata

cc3fe18b

models without vocabulary, convert.py part

4f4258fb

models without vocabulary, llama.cpp part

afa9d095

PR clean up

e0504d53

Xarbirus force pushed to e0504d53 2 years ago

cebtenzzre commented on 2024-03-08

converter scrypt fixes

0c690161

llama_vocab_type update (renamed the new key)

80f66a8a

cebtenzzre commented on 2024-03-12

pr review fixes

0a1322ac

revert function renaming

94a1050e

cebtenzzre commented on 2024-03-14

one more NoVocab assert

9cb1554f

cebtenzzre approved these changes on 2024-03-14

ggerganov merged 69ff6139 into master 2 years ago

Xarbirus deleted the models-without-vocab branch 2 years ago

Reviewers

ggerganov

cebtenzzre

Assignees

No one assigned

Labels

None yet

Milestone

No milestone