ggerganov/llama.cpp

Pull Requests Commits

graph : support cacheless embeddings with FA and iSWA (#16528)

ggerganov committed 25 days ago

Verified e38b7c6e

opencl: fix build targeting CL 2 (#16554)

lhez committed 25 days ago

Verified 5016b728

CUDA: fix numerical issues in tile FA kernel (#16540)

JohannesGaessler committed 25 days ago

Verified 7049736b

ggml : fix build broken with -march=armv9-a on MacOS (#16520)

DamonFool committed 25 days ago

Verified 01d2bdc2

CANN: fix CPU memory leak in CANN backend (#16549)

noemotiovon committed 25 days ago

Verified 56fc38b9

fix: add remark plugin to render raw HTML as literal text (#16505)

ServeurpersoCom committed 25 days ago

Verified 1fb9504e

metal: add support for opt_step_sgd (#16539)

cern1710 committed 25 days ago

Verified 3f750f8d

ggml : fix scalar path for computing norm (#16558)

ggerganov committed 25 days ago

Verified c515fc57

CANN: Update several operators to support FP16 data format (#16251)

hipudding committed 26 days ago

Verified f9bc66c3

metal : add opt_step_adamw and op_sum (#16529)

cern1710 committed 26 days ago

Verified a31cf36a

webui: remove client-side context pre-check and rely on backend for limits (#16506)

ServeurpersoCom committed 26 days ago

Verified 81d54bbf

[SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521)

NeoZhangJianyu committed 26 days ago

Verified c7be9feb

ci : add Vulkan on Ubuntu with default packages build (#16532)

mbaudier committed 26 days ago

Verified 8415f61e

common : handle unicode during partial json parsing (#16526)

aldehir committed 26 days ago

Verified 2c301e91

common : update presets (#16504)

ggerganov committed 26 days ago

Verified 4b2dae38

ggml : Fix FP16 ELU positive branch (#16519)

sirus20x6 committed 26 days ago

Verified 41aac5c6

hparams : add check for layer index in is_recurrent (#16511)

danbev committed 26 days ago

Verified a2fba89a

ggml: Correct SVE implementation in ggml_vec_dot_f16_unroll (#16518)

sirus20x6 committed 26 days ago

Verified 20cc625e

CUDA: faster tile FA, add oob checks, more HSs (#16492)

JohannesGaessler committed 27 days ago

Verified 11f0af55

metal : fix mul-mm condition + fix mul-mv permuted kernels (#16494)

ggerganov committed 27 days ago

Verified a3cb0474

feat: render user content as markdown option (#16358)

ServeurpersoCom committed 27 days ago

Verified 4a8fbe0a

server / ranking : add sorting and management of top_n (#16403)

YannFollet committed 27 days ago

Verified 31d0ff18

cuda : avoid initializing unused devices (#16510)

slaren committed 27 days ago

Verified 97870e64

convert : correctly handle LLaMA tokenizer for Jamba (#16470)

amirai21 committed 27 days ago

Verified 477a66b0

server : fix division by zero when reporting stats (#16501)

ggerganov committed 28 days ago

Verified e60f01d9

vocab : mark EOT token for Granite models (#16499)

ggerganov committed 28 days ago

Verified 81086cd6

server : return HTTP 400 if prompt exceeds context length (#16486)

rgerganov committed 28 days ago

Verified 68ee98ae

server : log requests to /v1/completions (#16495)

rgerganov committed 28 days ago

Verified cdb6da46

cmake : Dont define XOPENSOURCE on AIX (#16481)

mehendarkarprajwal committed 28 days ago

Verified 6d69ab3f

webui: updated the chat service to only include max_tokens in the req… (#16489)

ServeurpersoCom committed 29 days ago

Verified 1faa13a1

Newer Older