ggerganov/llama.cpp

Pull Requests Commits
tokenizer : special token handling (#3538)
staviq committed 2 years ago
Verified 1a159553
k-quants : fix quantization ranges (#3646)
ggerganov committed 2 years ago
Verified 281ef73c
llava : fix tokenization to not add bos between image embeddings and user prompt (#3645)
ggerganov committed 2 years ago
Verified 940efa95
MPT : support GQA for replit-code-v1.5 (#3627)
cebtenzzre committed 2 years ago
Verified 11bff290
Honor -ngl option for Cuda offloading in llava (#3621)
monatis committed 2 years ago
Verified 11dc1091
llama : remove n_threads from llama_decode_internal (#3614)
danbev committed 2 years ago
Verified 2a4bcbac
ggml : add context enumeration functions (#3605)
slaren committed 2 years ago
Verified 424b6381
CLBlast: Fix matrix-vector multiplication (#3544)
shibe2 committed 2 years ago
Verified 1e0e873c
examples: support LLaVA v1.5 (multimodal model) (#3436)
monatis committed 2 years ago
Verified 370359e5
docs : fix typo GOMP_CPU_AFFINITY (#3597)
maekawatoshiki committed 2 years ago
Verified 9e24cc6e
cmake : fix add_compile_options on macOS
ggerganov committed 2 years ago
Verified d28e572c
typo : it is `--n-gpu-layers` not `--gpu-layers` (#3592)
ianscrivener committed 2 years ago
Verified f3040bea
ci : check if there is enough VRAM (#3596)
ggerganov committed 2 years ago
Verified 1a8c8795
server : add completion mode (no chat) (#3582)
akx committed 2 years ago
Verified b016596d
prompts : add mnemonics.txt
ggerganov committed 2 years ago
Verified 6b3ae4da
server : fix kv cache management (#3588)
ggerganov committed 2 years ago
Verified 57dd55e2
main : fix session loading bug (#3400)
ggerganov committed 2 years ago
Verified b8fe4b5c
server : add parameter -tb N, --threads-batch N (#3584)
m18coppola committed 2 years ago
Verified a8bdd655
common : fix mirostat state when using multiple sequences (#3543)
KerfuffleV2 committed 2 years ago
Verified 70c29da1
batched : add bench tool (#3545)
ggerganov committed 2 years ago
Verified 8c70a5ff
examples : add batched.swift + improve CI for swift (#3562)
zshannon committed 2 years ago
Verified 24ba3d82
Add MPT model to supported models in README.md (#3574)
Galunid committed 2 years ago
Verified 9f6ede19
Minor improvements in GPT2 tokenizer (#3567)
goerch committed 2 years ago
Verified 233fc1c6
readme : add bloom (#3570)
xingchensong committed 2 years ago
Verified c5b49360
llm : add bloom models (#3553)
xingchensong committed 2 years ago
Verified 02d2875d
swift : improvements and fixes (#3564)
jhen0409 committed 2 years ago
Verified 0aa6595a
llm : add MPT support (#3417)
jploski committed 2 years ago
Verified f5f9121d
infill. : fix tokenization (#3508)
vvhg1 committed 2 years ago
Verified 11ea5c7d
ggml-alloc : fix assert in debug builds (#3555)
slaren committed 2 years ago
Verified 95bd60a0
refact : fix convert script + zero out KV cache to avoid nans (#3523)
ggerganov committed 2 years ago
Verified fcca0a70
Terms Of Use Privacy Policy Refund Policy Impressum