ggerganov/llama.cpp

Pull Requests Commits

llama : make starcoder graph build more consistent with others

ggerganov committed 2 years ago

Verified 92a4f868

metal : fix out-of-bounds access in soft_max kernels

ggerganov committed 2 years ago

Verified f82328ab

cleanup useless code

wsxiaoys committed 2 years ago

6c353dc7

working in cpu, metal buggy

wsxiaoys committed 2 years ago

a1cf66ea

wsxiaoys committed 2 years ago

101c5787

add input embeddings handling

wsxiaoys committed 2 years ago

8bc76a22

store mqa directly

wsxiaoys committed 2 years ago

ab13d071

fix vram calculation for starcoder

wsxiaoys committed 2 years ago

4420cff6

wsxiaoys committed 2 years ago

dac31da4

fix head count kv

wsxiaoys committed 2 years ago

0be15e16

properly load all starcoder params

wsxiaoys committed 2 years ago

77c7ec17

set n_positions to max_positioin_embeddings

wsxiaoys committed 2 years ago

26836119

add max_position_embeddings

wsxiaoys committed 2 years ago

a17ef397

load starcoder weight

wsxiaoys committed 2 years ago

57f064d7

set head_count_kv = 1

wsxiaoys committed 2 years ago

166a259f

add LLM_ARCH_STARCODER to llama.cpp

wsxiaoys committed 2 years ago

7298c37e

fix ffn_down name

wsxiaoys committed 2 years ago

7e0a843b

convert MQA to MHA

wsxiaoys committed 2 years ago

76d32cca

support convert starcoder weights to gguf

wsxiaoys committed 2 years ago

eb7f0eba

add placeholder of starcoder in gguf / llama.cpp

wsxiaoys committed 2 years ago

0c5d4d87

llama : make quantize example up to 2.7x faster (#3115)

cebtenzzre committed 2 years ago

Verified 98311c42

flake : allow $out/include to already exist (#3175)

jneem committed 2 years ago

Verified feea179e

cmake : compile ggml-rocm with -fpic when building shared library (#3158)

abetlen committed 2 years ago

Verified 769266a5

flake : include llama.h in nix output (#3159)

AsbjornOlling committed 2 years ago

Verified cf8238e7

make : fix clang++ detection, move some definitions to CPPFLAGS (#3155)

cebtenzzre committed 2 years ago

Verified 4b8560e7

CI: add FreeBSD & simplify CUDA windows (#3053)

alonfaraj committed 2 years ago

Verified 83a53b75

falcon : use stated vocab size (#2914)

akawrykow committed 2 years ago

Verified 5c872dbc

cmake : add relocatable Llama package (#2960)

bandoti committed 2 years ago

Verified 990a5e22

docker : add gpu image CI builds (#3103)

canardleteer committed 2 years ago

Verified 980ab41a

gguf-py : support identity operation in TensorNameMap (#3095)

KerfuffleV2 committed 2 years ago

Verified e3940841

Older