ggerganov/llama.cpp

Pull Requests Commits
unicode : set bomb
ggerganov committed 1 year ago
Verified 2affd0b2
unicode : set bomb
ggerganov committed 1 year ago
Verified a22645c2
minor
ggerganov committed 1 year ago
Verified 4434c9d6
llama : adapt punctuation regex + add llama 3 regex
ggerganov committed 1 year ago
Verified ad929833
models : add llama v3 vocab file
ggerganov committed 1 year ago
Verified 96965f67
wip
ggerganov committed 1 year ago
Verified c160818e
make : add test-tokenizer-0-llama-v3
ggerganov committed 1 year ago
Verified a774d708
lint : fix
ggerganov committed 1 year ago
Verified 8791e94e
Reset schedule earlier to allow overlap with ggml graph computation on device (#6933)
agray3 committed 1 year ago
Verified 928e0b70
quantize: add imatrix and dataset metadata in GGUF (#6658)
phymbert committed 1 year ago
Verified 0c4d489e
convert : fix pre-tokenizer type writing
ggerganov committed 1 year ago
Verified 1b9b79dd
llama : use new pre-tokenizer type
ggerganov committed 1 year ago
Verified 43e12ce8
add basic tensor data validation function (#6884)
slaren committed 1 year ago
Verified 017e6999
convert : add "tokenizer.ggml.pre" GGUF KV (wip)
ggerganov committed 1 year ago
Verified 9b4d63ae
Merge branch 'master' into gg/bpe-preprocess
ggerganov committed 1 year ago
Verified e3f6dc74
gguf : fix mismatch between alloc and free functions (#6929)
slaren committed 1 year ago
Verified e2764cd7
llamafile : use 64-bit integers in sgemm (#6928)
jart committed 1 year ago
Verified 4b1c3c98
unicode : first try custom implementations
ggerganov committed 1 year ago
Verified e9891769
unicode : shot in the dark to fix tests on Windows
ggerganov committed 1 year ago
Verified e8c206be
llama : towards llama3 tokenization support (wip)
ggerganov committed 1 year ago
Verified 4907e41a
gguf-py : reader prints warnings on duplicate keys
ggerganov committed 1 year ago
Verified ed42711b
tests : add sample usage
ggerganov committed 1 year ago
Verified e1b2bf78
tests : remove and rename tokenizer test scripts
ggerganov committed 1 year ago
Verified aeafb43e
unicode : remove redundant headers
ggerganov committed 1 year ago
Verified d999cf65
ci: server: fix python installation (#6925)
phymbert committed 1 year ago
Verified bbe3c6e7
tests : add tokenizer tests for numbers
ggerganov committed 1 year ago
Verified 7a44e443
server: stop generation at `n_ctx_train` if `n_predict` is not set (#6638)
phymbert committed 1 year ago
Verified 7f5ff558
lint : fix whitespaces
ggerganov committed 1 year ago
Verified c56e19db
unicode : fix? unicode_wstring_to_utf8
ggerganov committed 1 year ago
Verified 06d3e693
ci: server: fix python installation (#6922)
phymbert committed 1 year ago
Verified 9e4e077e
Terms Of Use Privacy Policy Refund Policy Impressum