ngxson/llama.cpp

Pull Requests Commits

common : update presets (#16504)

ggerganov committed 189 days ago

Verified 4b2dae38

ggml : Fix FP16 ELU positive branch (#16519)

sirus20x6 committed 189 days ago

Verified 41aac5c6

hparams : add check for layer index in is_recurrent (#16511)

danbev committed 189 days ago

Verified a2fba89a

ggml: Correct SVE implementation in ggml_vec_dot_f16_unroll (#16518)

sirus20x6 committed 189 days ago

Verified 20cc625e

CUDA: faster tile FA, add oob checks, more HSs (#16492)

JohannesGaessler committed 190 days ago

Verified 11f0af55

metal : fix mul-mm condition + fix mul-mv permuted kernels (#16494)

ggerganov committed 190 days ago

Verified a3cb0474

feat: render user content as markdown option (#16358)

ServeurpersoCom committed 190 days ago

Verified 4a8fbe0a

server / ranking : add sorting and management of top_n (#16403)

YannFollet committed 190 days ago

Verified 31d0ff18

cuda : avoid initializing unused devices (#16510)

slaren committed 190 days ago

Verified 97870e64

convert : correctly handle LLaMA tokenizer for Jamba (#16470)

amirai21 committed 190 days ago

Verified 477a66b0

server : fix division by zero when reporting stats (#16501)

ggerganov committed 190 days ago

Verified e60f01d9

vocab : mark EOT token for Granite models (#16499)

ggerganov committed 191 days ago

Verified 81086cd6

server : return HTTP 400 if prompt exceeds context length (#16486)

rgerganov committed 191 days ago

Verified 68ee98ae

server : log requests to /v1/completions (#16495)

rgerganov committed 191 days ago

Verified cdb6da46

cmake : Dont define XOPENSOURCE on AIX (#16481)

mehendarkarprajwal committed 191 days ago

Verified 6d69ab3f

webui: updated the chat service to only include max_tokens in the req… (#16489)

ServeurpersoCom committed 191 days ago

Verified 1faa13a1

cpu : optimize the ggml NORM operation (#15953)

duduta committed 191 days ago

Verified 1deee0f8

server : host-memory prompt caching (#16391)

ggerganov committed 192 days ago

Verified d00cbea6

No markdown in cot (#16483)

ServeurpersoCom committed 192 days ago

Verified 8328fd4b

model-conversion : add support for SentenceTransformers (#16387)

danbev committed 192 days ago

Verified 56b47958

ci: add ARM64 Kleidiai build and test support (#16462)

sudhiarm committed 192 days ago

Verified 2c0d875a

CANN: Improve ACL graph matching (#16166)

noemotiovon committed 192 days ago

Verified aa4711d3

kleidiai: kernel interface refactoring (#16460)

chaxu01 committed 192 days ago

Verified d80d6d24

[SYCL] refactor soft_max, add soft_max_back (#16472)

NeoZhangJianyu committed 192 days ago

Verified b2602137

model: EmbeddingGemma Adding Support for SentenceTransformers Dense Modules (#16367)

sfallah committed 192 days ago

Verified e08db425

refactor: centralize CoT parsing in backend for streaming mode (#16394)

ServeurpersoCom committed 192 days ago

Verified 12bbc3fa

Disable CUDA host buffers on integrated GPUs (#16308)

ai-fonsi committed 193 days ago

Verified 9d088284

server : fix cancel pending task (#16467)

issixx committed 193 days ago

Verified d2ee056e

metal : mark FA blocks (#16372)

ggerganov committed 193 days ago

Verified b2c08c9e

server : improve context checkpoint logic (#16440)

ggerganov committed 193 days ago

Verified 7fdd16b4

Newer Older