llama.cpp
Update llama2.c converter to read vocab and write models in GGUF format
#2751
Merged

Update llama2.c converter to read vocab and write models in GGUF format #2751

ggerganov merged 8 commits into ggml-org:master from ochafik:llama2c-gguf
ochafik
llama2.c: direct gguf output (WIP)
5132130a
Simplify vector building logic
463e1178
llama2.c gguf conversion: fix token types in converter
63174b80
llama2.c: support copying vocab from a llama gguf model file
c88362d1
ochafik ochafik force pushed to c88362d1 2 years ago
llama2.c: update default path for vocab model + readme
df3b81ab
llama2.c: use defines for gguf keys
20c44711
llama2.c: escape whitespaces w/ U+2581 in vocab converter the llama.c…
0722e58a
llama2.c converter: cleanups + take n_ff from config
c58792c7
ochafik ochafik changed the title [Draft] llama2.c: direct gguf output (WIP) Update llama2.c converter to read vocab and write models in GGUF format 2 years ago
ochafik ochafik marked this pull request as ready for review 2 years ago
ggerganov
ggerganov approved these changes on 2023-08-27
ggerganov ggerganov merged 230d46c7 into master 2 years ago
byte-6174
ochafik

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone