ggml-org/llama.cpp

Pull Requests Commits

Update gguf-py/gguf/constants.py

ngxson committed 3 days ago

Verified 16d2e011

ngxson committed 4 days ago

1e265f21

ngxson committed 4 days ago

bb8bf2c4

ngxson committed 4 days ago

ff15e572

Merge branch 'master' into xsn/decision_clef

ngxson committed 4 days ago

c290b7f4

more static graph

ngxson committed 4 days ago

6dd3354c

init support for clef (text only)

ngxson committed 4 days ago

f7c18f68

model: support nimble decision model (#29844)

ngxson committed 4 days ago

Verified 46ca246d

readme : add cmd install commands (#29850)

ggerganov committed 4 days ago

Verified d8fbd258

metal : add tensor API flash attention kernel for F16 KV (#29570)

ethanhq committed 4 days ago

Verified 926862e5

llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) (#29818)

ngxson committed 4 days ago

Verified a4cb4c61

common : remove fs_open_ifstream() by using u8path() (#29841)

angt committed 4 days ago

Verified 70849ee8

llama : silence unused-result warnings (#29839)

angt committed 4 days ago

Verified 8d81559f

llama : use GGML_ABORT instead of throw (#29840)

angt committed 4 days ago

Verified 6805ae35

opencl: use sigmoid f16 for bf16 (#29787)

lhez committed 4 days ago

Verified a8c9a4e7

SYCL: Q8_0 DMMV ESIMD and MMVQ wide load (#29186)

cwriter committed 4 days ago

Verified 392ded65

vulkan: disable large matmul tile on Samsung GPUs with 32KB shared memory (#28531)

jwsong98 committed 4 days ago

Verified 9e258a6e

sycl: large register file for D=512 FA vec kernels (#29062)

Titaniumtown committed 4 days ago

Verified b9332895

sycl : do not use slow oneDNN reference matmul and fattn (#28985)

lslusarczyk committed 4 days ago

Verified c328acc9

qwen4exp : optimize mask constructions (#29824)

ggerganov committed 4 days ago

Verified 4e2713c1

ggml : add `alloc_buffer_n` to buffer type interface (#23671)

ggerganov committed 4 days ago

Verified 631109b3

ci : fix missing zdnn backend check (#29837)

taronaeo committed 4 days ago

Verified 254b1773

vulkan: add logging to pipeline compile issues (#29794)

0cc4m committed 4 days ago

Verified fb4b2737

pyproject : add linux platform marker to uv torch source (#29177)

Yezat committed 4 days ago

Verified 207bdab9

hexagon: install rebuilt HTP skels (#29828)

kurquhar committed 4 days ago

Verified 5fc4f3c8

qwen4exp: fix tests (#29819)

am17an committed 4 days ago

Verified 159c651f

hexagon: add q2_k and q3_k quant type support (#29717)

jhen0409 committed 4 days ago

Verified a868c3e3

CUDA: fix 2 broken Volta FA cases (#29803)

JohannesGaessler committed 4 days ago

Verified ec7630a6

llama: refer to segment documentation [no ci] (#29074)

JohannesGaessler committed 4 days ago

Verified 78e2964c

common,rpc : fix cache dir creation through symlinks on buggy libstdc++ (#29816)

angt committed 5 days ago

Verified f1cee994

Older