ggerganov/llama.cpp

Pull Requests Commits

ggerganov committed 2 years ago

Verified ddc59e8e

convert-hf : support Mini-Jamba conversion

compilade committed 2 years ago

fc59407e

convert-hf : check for unprocessed Jamba experts

compilade committed 2 years ago

ea2e63e9

llama : fix BERT inference without KV cache

compilade committed 2 years ago

61a88a1d

Merge branch 'master' into compilade/refactor-kv-cache

compilade committed 2 years ago

0fd13e94

llama : support Jamba

compilade committed 2 years ago

cbc743e6

llama : rethink recurrent state cell counts

compilade committed 2 years ago

7e13f19f

flake.lock: Update (#7232)

ggerganov committed 2 years ago

Verified d041d2ce

docker.yml: disable light-intel and server-intel test (#7515)

mofosyne committed 2 years ago

Verified 27891f6d

Add support for ArcticForCausalLM (#7020)

fairydreaming committed 2 years ago

Verified fbca2f27

add build shared lib in win release package (#7438)

arthw committed 2 years ago

Verified 0df0aa8e

readme : remove trailing space (#7469)

ggerganov committed 2 years ago

Verified 74f33adf

ggml : silence UB sanitizer error during iq2_xxs quantization (#0)

ggerganov committed 2 years ago

Verified 1debe727

Fix phi3 chat template confusion with zephyr (#7449)

tristandruyen committed 2 years ago

Verified 007489e8

readme : add Bunny in supported models [no ci] (#7469)

criminact committed 2 years ago

Verified 8b94e799

llama : add getters for n_threads/n_threads_batch (#7464)

danbev committed 2 years ago

Verified 3015851c

ci : use Pythia models instead of OpenLlama (#7470)

ggerganov committed 2 years ago

Verified 55ac3b7a

readme : add GPT-NeoX + Pythia to the list of supported models (#7491)

felladrin committed 2 years ago

Verified dacfcebd

Add missing inference support for GPTNeoXForCausalLM (Pythia and GPT-NeoX base models) (#7461)

fairydreaming committed 2 years ago

Verified 9b82476e

llama : rename n_ctx -> cache.size, less confusing (#0)

ggerganov committed 2 years ago

Verified a61a94e5

labeler.yml: add embedding label detector [no ci] (#7482)

mofosyne committed 2 years ago

Verified 152da28a

ggml : remove ggml_flash_attn and ggml_flash_ff (#7463)

ggerganov committed 2 years ago

Verified d48c88cb

ggml : drop support for QK_K=64 (#7473)

ggerganov committed 2 years ago

Verified e84b71c2

Update vulkan rope implementation to support frequency factors (#7475)

0cc4m committed 2 years ago

Verified 1b1e27cb

main : minor (#7462)

ggerganov committed 2 years ago

Verified fbf777d2

CUDA: fix FA out-of-bounds reads (#7479)

JohannesGaessler committed 2 years ago

Verified cd93a28c

Merge branch 'master' into compilade/refactor-kv-cache

compilade committed 2 years ago

3b57b55c

SimpleChat: a simple and dumb web front end for testing /chat/completions and /completions end points and try chat (#7350)

hanishkvc committed 2 years ago

Verified 1e374365

build : remove zig (#7471)

ggerganov committed 2 years ago

Verified 197ff914

common : normalize naming style (#7462)

ggerganov committed 2 years ago

Verified 6ff13987

Older