ggml-org/llama.cpp

Pull Requests Commits
Add --cfg-negative-prompt-file option for examples (#2591)
KerfuffleV2 committed 2 years ago
Verified 8dae7ce6
llama.cpp : use ggml_elements()
klosax committed 2 years ago
Verified d6fd53af
llama.cpp : print actual model size
klosax committed 2 years ago
Verified 5a0a2c56
gguf : single pass for writing tensors + refactoring writer
monatis committed 2 years ago
f31e9230
llama : replace (permute + reshape + view_1d) with (view_3d) (#2538)
ggerganov committed 2 years ago
Verified a73ccf1a
tests : adds simple llama grammar tests (#2618)
drbh committed 2 years ago
Verified 7cf54e1f
ggml-alloc : fix discrepency between measure&eval (#2639)
lshzh-ww committed 2 years ago
Verified a872a2b2
examples/gguf : no need to keep q option for quantization any more
monatis committed 2 years ago
42f8fe19
cmake : install ggml-meta.metal if LLAMA_METAL (#2449)
ickc committed 2 years ago
Verified 0919a0f7
metal : print error of load pipeline state (#2564)
jhen0409 committed 2 years ago
Verified ed53db86
metal : enable ggml-alloc (#2627)
lshzh-ww committed 2 years ago
Verified fc8ef549
metal : matrix-matrix multiplication kernel (#2615)
lshzh-ww committed 2 years ago
Verified bf83bff6
convert-new.py : pick #2427 for HF 70B support
ggerganov committed 2 years ago
Verified 5ec18934
gguf.py : merge all files in gguf.py
ggerganov committed 2 years ago
Verified c8ee87f1
gguf : deduplicate (#2629)
ggerganov committed 2 years ago
Verified 88b57694
llama : refactor model loading code (#2620)
ggerganov committed 2 years ago
Verified 758ff1bb
convert-llama-h5-to-gguf.py : clarify the reverse permute
klosax committed 2 years ago
Verified ea5615a0
gptneox-main.cpp : add tensor data layout
klosax committed 2 years ago
Verified 4a1741aa
convert-llama-7b-pth-to-gguf.py : add tensor data layout
klosax committed 2 years ago
Verified 2ae0e985
convert-llama-h5-to-gguf.py : add tensor data layout
klosax committed 2 years ago
Verified 66756c82
gguf.py : add tensor data layout
klosax committed 2 years ago
Verified b6056c3d
scripts : add helper script to get wikitext
ggerganov committed 2 years ago
Verified b5ffb284
convert-llama-h5-to-gguf.py : add 70b gqa support
klosax committed 2 years ago
Verified 2dd5d2c9
server : add missing /json-schema-to-grammar.mjs (#2616)
jhen0409 committed 2 years ago
Verified 3ebb0093
gguf-llama.cpp : fix n_head_kv
klosax committed 2 years ago
Verified ca475829
convert-llama-7b-pth-to-gguf.py : add token types
klosax committed 2 years ago
Verified ab2cbd03
gguf.py : add token types
klosax committed 2 years ago
Verified cedb4870
constants.py : add token types
klosax committed 2 years ago
Verified 5d518d42
convert-llama-h5-to-gguf.py : add token types
klosax committed 2 years ago
Verified 7ec125b1
llama : update tokenizer style
ggerganov committed 2 years ago
Verified 6c63550f
Terms Of Use Privacy Policy Refund Policy Impressum