ggml-org/llama.cpp

Pull Requests Commits

server : fix handling of the ignore_eos flag

ggerganov committed 1 year ago

Verified 9f8d2859

llama: add LLAMA_API to deprecated llama_kv_self_seq_div (#14708)

Min-Hua committed 1 year ago

Verified 79e0b68c

gguf-py : dump bpw per layer and model in markdown mode (#14703)

EAddario committed 1 year ago

Verified c81f4192

model : add Kimi-K2 support (#14654)

gabriellarson committed 1 year ago

Verified 4a4f4269

vulkan: fix noncontig check for mat_mul_id splitting (#14683)

jeffbolznv committed 1 year ago

Verified ba1ceb34

vulkan: add RTE variants for glu/add/sub/mul/div (#14653)

jeffbolznv committed 1 year ago

Verified 10a0351a

model : add PLaMo-2 support (#14560)

mitmul committed 1 year ago

Verified 68e37a61

cuda: fix build warnings in set-rows.cu (unused variable) (#14687)

yeahdongcn committed 1 year ago

Verified cbc68be5

sycl: Hotfix for non dnnl codepath (#14677)

ShanoToni committed 1 year ago

Verified bdca3837

ggml : refactor llamafile_sgemm PPC code (#14673)

shalinib-ibm committed 1 year ago

Verified 55c509da

llama-context: add ability to get logits (#14672)

am17an committed 1 year ago

Verified 9c9e4fc6

scripts: benchmark for HTTP server throughput (#14668)

JohannesGaessler committed 1 year ago

Verified 494c5899

SYCL: use 1D kernel for set_rows (#14618)

qnixsynapse committed 1 year ago

Verified 0f4c6ec0

sycl: Batched mulmat rework for oneDNN dispatch (#14617)

ShanoToni committed 1 year ago

Verified 65a3ebb0

llama : add jinja template for rwkv-world (#14665)

MollySophia committed 1 year ago

Verified 0d922676

quantize : fix minor logic flaw in --tensor-type (#14572)

EAddario committed 1 year ago

Verified 982e3472

cuda : add set rows for bf16 (#14664)

CISC committed 1 year ago

Verified 923e3ea2

cuda : add ELU support (#14657)

YavorGIvanov committed 1 year ago

Verified e743cddb

ggml : add build-time message to remind about ggml_set_rows (#14661)

ggerganov committed 1 year ago

Verified 05fec5bd

metal : Add missing unary ops Metal support (#14660)

YavorGIvanov committed 1 year ago

Verified dcf7f2ea

cmake : Add CMake presets for Linux and GCC (#14656)

YavorGIvanov committed 1 year ago

Verified 84b396e0

tests : cover lfm2 cases in test_ssm_conv (#14651)

tdakhran committed 1 year ago

Verified c31e6064

docs : add LFM2 to models section (#14650)

tdakhran committed 1 year ago

Verified 67eade1b

CUDA: add set rows for f32 and f16 (#14551)

am17an committed 1 year ago

Verified 7de5c7ca

ggerganov committed 1 year ago

8eff9554

vulkan : remove unused vars (#0)

ggerganov committed 1 year ago

3120413c

ggerganov committed 1 year ago

21553570

vulkan : implement bilinear interpolation (ggml/1291)

Acly committed 1 year ago

74bb2945

vulkan : implement ggml_roll (ggml/1290)

Acly committed 1 year ago

3e303b11

server : fix pooled embedding output (#14645)

iamlemec committed 1 year ago

Verified 0c1df14b

Older