convert.py: Hot Fix with VocabFactory Integration #4818
ggerganov
merged
16 commits into
ggml-org:master
from
convert-py
Update Imports and Add Notes for Future Reference
b69021ef
Merge branch 'master' into convert-py
acf8f4b2
Refine Model Hyperparameters and Params Class
15e18973
Restore BpeVocab and SentencePieceVocab classes
3ca2b100
refactor: Standardize vocabulary handling with HfVocab
db4b8ac3
refactor: Enhance readability, functionality, and code quality
7e4a4ebc
refactor: Update OutputFile class for enhanced model vocabulary manag…
5fa1a08c
feat: Introduce VocabFactory for flexible vocabulary management in mo…
8aa5818a
refactor: Improve code organization, argument parsing, and user inter…
226cea27
refactor: Further refine functionality, improve user interaction, and…
0614c338
chore: Apply ruff formatting to convert.py
c6af89e5
Revert to commit 0614c33
29abd8d4
chore: Apply flake8 formatting rules
dd1c1004
refactor: Revise `check_vocab_size` for Enhanced Clarity and Correctness
787860ad
py : fix outfile and outtype
90582b73
py : suggest hint for missing vocab size
7cfcee40
Login to write a write a comment.
Login via GitHub