ggml-org/llama.cpp

Pull Requests Commits
chat.mjs support cached prompt + some fixes
FSSRepo committed 2 years ago
4ba5a501
llama : remove n_threads from llama_decode_internal (#3614)
danbev committed 2 years ago
Verified 2a4bcbac
ggml : add context enumeration functions (#3605)
slaren committed 2 years ago
Verified 424b6381
cached prompt support
FSSRepo committed 2 years ago
500ac712
grammar + no stream completion
FSSRepo committed 2 years ago
83c2b355
multiple client support
FSSRepo committed 2 years ago
5b8e29de
completion endpoint working
FSSRepo committed 2 years ago
81484805
CLBlast: Fix matrix-vector multiplication (#3544)
shibe2 committed 2 years ago
Verified 1e0e873c
refactored sampling function
FSSRepo committed 2 years ago
29c8cdd6
Merge branch 'master' of https://github.com/ggerganov/llama.cpp
FSSRepo committed 2 years ago
b716eeb7
save dev progress
FSSRepo committed 2 years ago
78504218
examples: support LLaVA v1.5 (multimodal model) (#3436)
monatis committed 2 years ago
Verified 370359e5
docs : fix typo GOMP_CPU_AFFINITY (#3597)
maekawatoshiki committed 2 years ago
Verified 9e24cc6e
cmake : fix add_compile_options on macOS
ggerganov committed 2 years ago
Verified d28e572c
typo : it is `--n-gpu-layers` not `--gpu-layers` (#3592)
ianscrivener committed 2 years ago
Verified f3040bea
ci : check if there is enough VRAM (#3596)
ggerganov committed 2 years ago
Verified 1a8c8795
server : add completion mode (no chat) (#3582)
akx committed 2 years ago
Verified b016596d
prompts : add mnemonics.txt
ggerganov committed 2 years ago
Verified 6b3ae4da
server : fix kv cache management (#3588)
ggerganov committed 2 years ago
Verified 57dd55e2
crash fixed
FSSRepo committed 2 years ago
47123020
implementing parallel decoding in server example
FSSRepo committed 2 years ago
63f99b1e
main : fix session loading bug (#3400)
ggerganov committed 2 years ago
Verified b8fe4b5c
server : add parameter -tb N, --threads-batch N (#3584)
m18coppola committed 2 years ago
Verified a8bdd655
common : fix mirostat state when using multiple sequences (#3543)
KerfuffleV2 committed 2 years ago
Verified 70c29da1
batched : add bench tool (#3545)
ggerganov committed 2 years ago
Verified 8c70a5ff
examples : add batched.swift + improve CI for swift (#3562)
zshannon committed 2 years ago
Verified 24ba3d82
Add MPT model to supported models in README.md (#3574)
Galunid committed 2 years ago
Verified 9f6ede19
Minor improvements in GPT2 tokenizer (#3567)
goerch committed 2 years ago
Verified 233fc1c6
readme : add bloom (#3570)
xingchensong committed 2 years ago
Verified c5b49360
llm : add bloom models (#3553)
xingchensong committed 2 years ago
Verified 02d2875d
Terms Of Use Privacy Policy Refund Policy Impressum