ochafik/llama.cpp

Pull Requests Commits

Apply suggestions from code review

ochafik committed 1 year ago

Verified 7a6c5e62

Update minja.hpp

ochafik committed 1 year ago

e4fb9e8c

vendor: sync minja

ochafik committed 1 year ago

6915d13b

opencl: add `swiglu_oai` and `add_id` (#15121)

lhez committed 1 year ago

Verified e725a1a9

chat : support Granite model reasoning and tool call (#14864)

smdesai committed 1 year ago

Verified 3db4da56

Fixed name `-override-tensors` to `-override-tensor` (#15129)

jukofyork committed 1 year ago

Verified 476aa3fd

ggml : fix fallback to CPU for ununsupported ops (#15118)

slaren committed 1 year ago

Verified 0d883154

chat : fix yandex chat template (#15116)

CISC committed 1 year ago

Verified 65c797c4

chat : fix hunyuan auto-detection (#15114)

stevenkuang-tencent committed 1 year ago

Verified 25726898

CANN: add support for ACL Graph (#15065)

noemotiovon committed 1 year ago

Verified 22414532

ggml: WebGPU disable SET_ROWS for now (#15078)

reeselevine committed 1 year ago

Verified 9515c613

llama : add gpt-oss (#15091)

ggerganov committed 1 year ago

Verified fd1234cb

chat : only remove double bos/eos if added (#15086)

CISC committed 1 year ago

Verified f324a3b7

readme : update hot topics (#15097)

ggerganov committed 1 year ago

Verified be426425

sycl: fix mul_mat selection (#15092)

Rbiessy committed 1 year ago

Verified 3306ceab

Fix `glm4moe` bug (#15088)

jukofyork committed 1 year ago

Verified c81de6e1

webui: fix markdown table (#15081)

dindinw committed 1 year ago

Verified 22f060c9

context : fix index overflow on huge outputs (#15080)

compilade committed 1 year ago

Verified ee3a9fcf

llama : add --n-cpu-moe option (#15077)

slaren committed 1 year ago

Verified ec428b02

imatrix : warn when GGUF imatrix is saved without .gguf suffix (#15076)

compilade committed 1 year ago

Verified 19f68fa5

cmake: Add GGML_BACKEND_DIR option (#15074)

ckastner committed 1 year ago

Verified 41613437

gguf-py : add --chat-template-file to gguf_new_metadata (#15075)

CISC committed 1 year ago

Verified e5bebe52

model: support GLM 4.5 family of models (#14939)

sammcj committed 1 year ago

Verified ef0144c0

quantize : fix confusing error message if ftype is invalid (#15071)

CISC committed 1 year ago

Verified 2721257e

ggml: WebGPU backend host improvements and style fixing (#14978)

reeselevine committed 1 year ago

Verified 587d0118

vulkan: fix build when using glslang that does not support coopmat2 (#15062)

jeffbolznv committed 1 year ago

Verified 5aa1105d

imatrix : use GGUF by default (#14842)

compilade committed 1 year ago

Verified d31192b4

imatrix : fix 3d activation handling for hybrid and recurrent models (#14994)

compilade committed 1 year ago

Verified 0a2f5496

memory : handle kv_unified for hybrid models (#15050)

compilade committed 1 year ago

Verified 11a38111

vocab : JetBrains Mellum pre-tokenizer (#15045)

csabakecskemeti committed 1 year ago

Verified 97366dc6

Older