ggerganov/llama.cpp

Pull Requests Commits

llama : better express the KV cache dependencies in the graph

ggerganov committed 2 years ago

Verified f3a84b2e

metal : utilize view_src to see of tensor is a view

ggerganov committed 2 years ago

Verified 60c2ef6d

metal : more readable kernel

ggerganov committed 2 years ago

Verified ebd3467c

ggml : just in case

ggerganov committed 2 years ago

Verified 7704db25

llama : add ggml_cont to trigger bug with Metal

ggerganov committed 2 years ago

Verified ad80e5a4

ggml-opencl : store GPU buffer in ggml_tensor::extra (#2994)

slaren committed 2 years ago

Verified bd33e5ab

llama-bench : make cpp file non-executable (#2999)

cebtenzzre committed 2 years ago

Verified 31035681

make : add speculative example (#3003)

leng-yue committed 2 years ago

Verified 5b8530d8

server : add a subtle loading animation to the edit box (#2466)

akx committed 2 years ago

Verified e4386f41

2x faster (rms) norm cuda kernels (3.7% e2e improvement) (#2985)

li-plus committed 2 years ago

Verified 35195689

ggml-alloc : use virtual memory for measurement (#2973)

slaren committed 2 years ago

Verified cf9b0848

speculative : PoC for speeding-up inference via speculative sampling (#2926)

ggerganov committed 2 years ago

Verified 47068e51

perplexity : fix ETA by warming up the model with an empty run

ggerganov committed 2 years ago

Verified 8f429fa5

gguf(python): Fix special vocab handling when id < 0 (#2984)

KerfuffleV2 committed 2 years ago

Verified 6519e9c9

metal : restore 363f0bf and fix reduce in F16_F32 kernels (#2986)

ggerganov committed 2 years ago

Verified b7f2aa9e

cov : disable comment in PRs (#2989)

alonfaraj committed 2 years ago

Verified 73a12a63

llama : fix bpe tokenize from byte (#2889)

opparco committed 2 years ago

Verified 37301347

metal : revert 6af0bab until we fix it

ggerganov committed 2 years ago

Verified d9151e6f

cov : add Code Coverage and codecov.io integration (#2928)

alonfaraj committed 2 years ago

Verified afc43d5f

opencl : fix a bug in ggml_cl_pool_malloc() for ggml_cl_mul_mat_f32() (#2955)

rchardx committed 2 years ago

Verified 6460f758

metal : more optimizations (#2959)

ikawrakow committed 2 years ago

Verified ca82cf7b

swift : add support for k-quants (#2983)

kchro3 committed 2 years ago

Verified 6a31a3bd

convert.py : BPE fixes (#2938)

KerfuffleV2 committed 2 years ago

Verified cff7b0bf

docs : add `catai` to `README.md` (#2967)

ido-pluto committed 2 years ago

Verified 340af42f

examples : fix gpt-neox (#2943)

mmnga committed 2 years ago

Verified c42f0ec6

swift : add missing c file to Package.swift (#2978)

kchro3 committed 2 years ago

Verified 2753415a

make : support overriding CFLAGS/CXXFLAGS/CPPFLAGS/LDFLAGS (#2886)

cebtenzzre committed 2 years ago

Verified bc054af9

logging: Fix creating empty file even when disabled (#2966)

KerfuffleV2 committed 2 years ago

Verified 3358c381

readme : update clblast instructions (#2903)

bandoti committed 2 years ago

Verified 52315a42

metal : show all Metal device instances in the system (#2952)

knweiss committed 2 years ago

Verified 8b56b4f2

Older