ggml-org/llama.cpp

Pull Requests Commits
fix embeddings when using CUDA (#3657)
slaren committed 2 years ago
Verified cb33f43a
llama : avoid fprintf in favor of LLAMA_LOG (#3538)
ggerganov committed 2 years ago
Verified e1675d13
readme : update hot-topics & models, detail windows release in usage (#3615)
BarfingLemurs committed 2 years ago
Verified 8402566a
CLBlast: Fix temporary buffer size for f16 conversion (wsize)
shibe2 committed 2 years ago
40e5ce05
train-text-from-scratch : fix assert failure in ggml-alloc (#3618)
slaren committed 2 years ago
Verified a5e8c1d8
editorconfig : remove trailing spaces
ggerganov committed 2 years ago
Verified e74c705e
server : documentation of JSON return value of /completion endpoint (#3632)
coezbek committed 2 years ago
Verified 3ad1e3f1
save-load-state : fix example + add ci test (#3655)
ggerganov committed 2 years ago
Verified 1142013d
readme : add Aquila2 links (#3610)
ftgreat committed 2 years ago
Verified 5fe268a4
tokenizer : special token handling (#3538)
staviq committed 2 years ago
Verified 1a159553
k-quants : fix quantization ranges (#3646)
ggerganov committed 2 years ago
Verified 281ef73c
llava : fix tokenization to not add bos between image embeddings and user prompt (#3645)
ggerganov committed 2 years ago
Verified 940efa95
MPT : support GQA for replit-code-v1.5 (#3627)
cebtenzzre committed 2 years ago
Verified 11bff290
Honor -ngl option for Cuda offloading in llava (#3621)
monatis committed 2 years ago
Verified 11dc1091
llama : remove n_threads from llama_decode_internal (#3614)
danbev committed 2 years ago
Verified 2a4bcbac
ggml : add context enumeration functions (#3605)
slaren committed 2 years ago
Verified 424b6381
CLBlast: Fix matrix-vector multiplication (#3544)
shibe2 committed 2 years ago
Verified 1e0e873c
examples: support LLaVA v1.5 (multimodal model) (#3436)
monatis committed 2 years ago
Verified 370359e5
docs : fix typo GOMP_CPU_AFFINITY (#3597)
maekawatoshiki committed 2 years ago
Verified 9e24cc6e
cmake : fix add_compile_options on macOS
ggerganov committed 2 years ago
Verified d28e572c
typo : it is `--n-gpu-layers` not `--gpu-layers` (#3592)
ianscrivener committed 2 years ago
Verified f3040bea
ci : check if there is enough VRAM (#3596)
ggerganov committed 2 years ago
Verified 1a8c8795
server : add completion mode (no chat) (#3582)
akx committed 2 years ago
Verified b016596d
prompts : add mnemonics.txt
ggerganov committed 2 years ago
Verified 6b3ae4da
server : fix kv cache management (#3588)
ggerganov committed 2 years ago
Verified 57dd55e2
main : fix session loading bug (#3400)
ggerganov committed 2 years ago
Verified b8fe4b5c
server : add parameter -tb N, --threads-batch N (#3584)
m18coppola committed 2 years ago
Verified a8bdd655
common : fix mirostat state when using multiple sequences (#3543)
KerfuffleV2 committed 2 years ago
Verified 70c29da1
batched : add bench tool (#3545)
ggerganov committed 2 years ago
Verified 8c70a5ff
examples : add batched.swift + improve CI for swift (#3562)
zshannon committed 2 years ago
Verified 24ba3d82
Terms Of Use Privacy Policy Refund Policy Impressum