PR #5288 convert : fix TypeError on GPT-2 vocab.json

convert : fix TypeError on GPT-2 vocab.json #5288

cebtenzzre merged 2 commits into ggml-org:master from patch-1

Add `TypeError` exception for BPE vocab.

531b4705

cebtenzzre commented on 2024-02-02

Modify the vocab selection algorithm.

15c2df91

cebtenzzre approved these changes on 2024-02-04

cebtenzzre changed the title ~~Add `TypeError` exception for BPE vocab.~~ convert : fix TypeError on GPT-2 vocab.json 2 years ago

cebtenzzre merged f68664ac into master 2 years ago

Reviewers

cebtenzzre

Assignees

No one assigned

Labels

None yet

Milestone

No milestone