ggerganov/llama.cpp

Pull Requests Commits

ggml : temporary disable llamafile sgemm until fixed

ggerganov committed 1 year ago

Verified f02ea667

ggml : add llamafile sgemm (#6414)

jart committed 1 year ago

Verified 8cc91dc6

llama : add StableLM2 12B (#6635)

ashishdatta committed 1 year ago

Verified dbceec87

llama : add qwen2moe (#6074)

simonJJJ committed 1 year ago

Verified f4dea7da

gritlm : add --outdir option to hf.sh script (#6699)

danbev committed 1 year ago

Verified 8a56075b

perplexity : require positive --ctx-size arg (#6695)

ggerganov committed 1 year ago

Verified 58227ffd

gguf : add special tokens metadata for FIM/Infill (#6689)

danbev committed 1 year ago

Verified 4fbd8098

`main`: add --json-schema / -j flag (#6659)

ochafik committed 1 year ago

Verified 7593639c

llama : fix restoring the number of outputs from state files (#6687)

compilade committed 1 year ago

Verified 132f5579

server : revert "minor layout improvements" (#6684)

phymbert committed 1 year ago

Verified 3272896d

swift : linux support (#6590)

spprichard committed 1 year ago

Verified 7fc16a2c

fix mul_mat_id() for new input, make the ut pass (#6682)

NeoZhangJianyu committed 1 year ago

Verified 17e98d4c

llama : add missing kv clear in llama_beam_search (#6664)

dwrensha committed 1 year ago

Verified 1958f7e0

Add Command R chat template (#6650)

jc19chaoj committed 1 year ago

Verified 04fbc5f2

flake.lock: Update (#6669)

ggerganov committed 1 year ago

Verified f184dd92

Added support for GGML_OP_CLAMP in Metal (#6662)

dave-fl committed 1 year ago

Verified 422c2aff

Fix --split-max-size (#6655)

CISC committed 1 year ago

Verified 8800226d

[bug fix] convert github repository_owner to lowercase (#6673)

jaeminSon committed 1 year ago

Verified e689fc4e

convert : enable the `--use-temp-file` cli flag (#6645)

jac-jim committed 1 year ago

Verified a4ec34e1

fix memcpy() crash, add missed cmd in guide, fix softmax (#6622)

NeoZhangJianyu committed 1 year ago

Verified de17e3f7

CUDA: fix matrix multiplication logic for tests (#6667)

JohannesGaessler committed 1 year ago

Verified b5e7285b

model: support arch `DbrxForCausalLM` (#6515)

phymbert committed 1 year ago

Verified 4bd0f93e

JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)

ochafik committed 1 year ago

Verified ab9a3240

metal : unify mul_mv_id kernels (#6556)

slaren committed 1 year ago

Verified fbbc030b

infill : add download instructions for model (#6626)

danbev committed 1 year ago

Verified 4cc120c7

server : coherent log output for KV cache full (#6637)

phymbert committed 1 year ago

Verified 24ee66ed

llama : add gguf_remove_key + remove split meta during quantize (#6591)

zj040045 committed 1 year ago

Verified 91c73601

chore: Fix markdown warnings (#6625)

reneleonhardt committed 1 year ago

Verified 5c4d767a

imatrix : remove invalid assert (#6632)

ggerganov committed 1 year ago

Verified ef21ce4c

Correct free memory and total memory. (#6630)

MasterYi1024 committed 1 year ago

Verified dee7f8d6

Older