ggerganov/llama.cpp

Pull Requests Commits

ggml : fix rope + llama minor optimizations (#3560)

GermanAizek committed 2 years ago

Verified f439e506

convert : restore compat with old Falcon models (#3680)

cebtenzzre committed 2 years ago

Verified e78f3ef2

multimodal : add BakLLaVA conversion support (#3682)

monatis committed 2 years ago

Verified f3b25e40

llava : avoid segfault in case of non-existent mmproj file (#3674)

monatis committed 2 years ago

Verified 60abea97

readme : update hot topics

ggerganov committed 2 years ago

Verified 004797f6

speculative : bug fixes

ggerganov committed 2 years ago

Verified 4e82b2ea

speculative : add tree-based sampling example (#3624)

ggerganov committed 2 years ago

Verified 0e89203b

metal : implement q5_0 and q5_1 kernels (#3648)

jhen0409 committed 2 years ago

Verified c67fe68e

opencl : fix element-wise multiplication (#3656)

shibe2 committed 2 years ago

Verified 1117d066

fix embeddings when using CUDA (#3657)

slaren committed 2 years ago

Verified cb33f43a

llama : avoid fprintf in favor of LLAMA_LOG (#3538)

ggerganov committed 2 years ago

Verified e1675d13

readme : update hot-topics & models, detail windows release in usage (#3615)

BarfingLemurs committed 2 years ago

Verified 8402566a

CLBlast: Fix temporary buffer size for f16 conversion (wsize)

shibe2 committed 2 years ago

40e5ce05

train-text-from-scratch : fix assert failure in ggml-alloc (#3618)

slaren committed 2 years ago

Verified a5e8c1d8

editorconfig : remove trailing spaces

ggerganov committed 2 years ago

Verified e74c705e

server : documentation of JSON return value of /completion endpoint (#3632)

coezbek committed 2 years ago

Verified 3ad1e3f1

save-load-state : fix example + add ci test (#3655)

ggerganov committed 2 years ago

Verified 1142013d

readme : add Aquila2 links (#3610)

ftgreat committed 2 years ago

Verified 5fe268a4

tokenizer : special token handling (#3538)

staviq committed 2 years ago

Verified 1a159553

k-quants : fix quantization ranges (#3646)

ggerganov committed 2 years ago

Verified 281ef73c

llava : fix tokenization to not add bos between image embeddings and user prompt (#3645)

ggerganov committed 2 years ago

Verified 940efa95

MPT : support GQA for replit-code-v1.5 (#3627)

cebtenzzre committed 2 years ago

Verified 11bff290

Honor -ngl option for Cuda offloading in llava (#3621)

monatis committed 2 years ago

Verified 11dc1091

llama : remove n_threads from llama_decode_internal (#3614)

danbev committed 2 years ago

Verified 2a4bcbac

ggml : add context enumeration functions (#3605)

slaren committed 2 years ago

Verified 424b6381

CLBlast: Fix matrix-vector multiplication (#3544)

shibe2 committed 2 years ago

Verified 1e0e873c

examples: support LLaVA v1.5 (multimodal model) (#3436)

monatis committed 2 years ago

Verified 370359e5

docs : fix typo GOMP_CPU_AFFINITY (#3597)

maekawatoshiki committed 2 years ago

Verified 9e24cc6e

cmake : fix add_compile_options on macOS

ggerganov committed 2 years ago

Verified d28e572c

typo : it is `--n-gpu-layers` not `--gpu-layers` (#3592)

ianscrivener committed 2 years ago

Verified f3040bea

Newer Older