whisper.cpp
Changed convert-pt-to-ggml.py to use .tiktoken tokenizer files
#725
Merged

Changed convert-pt-to-ggml.py to use .tiktoken tokenizer files #725

ggerganov merged 1 commit into ggml-org:master from ivan-gorin:master
ivan-gorin
ivan-gorin Changed convert-pt-to-ggml to use .tiktoken tokenizer files
c0ad8bb8
ivan-gorin ivan-gorin force pushed from cda97bc1 to c0ad8bb8 3 years ago
ggerganov
ggerganov approved these changes on 2023-04-14
ggerganov ggerganov merged 62b51c30 into master 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone