ggerganov/llama.cpp

Pull Requests Commits
ggml : Fix FP16 ELU positive branch (#16519)
sirus20x6 committed 27 days ago
Verified 41aac5c6
hparams : add check for layer index in is_recurrent (#16511)
danbev committed 27 days ago
Verified a2fba89a
ggml: Correct SVE implementation in ggml_vec_dot_f16_unroll (#16518)
sirus20x6 committed 27 days ago
Verified 20cc625e
CUDA: faster tile FA, add oob checks, more HSs (#16492)
JohannesGaessler committed 27 days ago
Verified 11f0af55
metal : fix mul-mm condition + fix mul-mv permuted kernels (#16494)
ggerganov committed 27 days ago
Verified a3cb0474
feat: render user content as markdown option (#16358)
ServeurpersoCom committed 27 days ago
Verified 4a8fbe0a
server / ranking : add sorting and management of top_n (#16403)
YannFollet committed 27 days ago
Verified 31d0ff18
cuda : avoid initializing unused devices (#16510)
slaren committed 27 days ago
Verified 97870e64
convert : correctly handle LLaMA tokenizer for Jamba (#16470)
amirai21 committed 27 days ago
Verified 477a66b0
server : fix division by zero when reporting stats (#16501)
ggerganov committed 28 days ago
Verified e60f01d9
vocab : mark EOT token for Granite models (#16499)
ggerganov committed 28 days ago
Verified 81086cd6
server : return HTTP 400 if prompt exceeds context length (#16486)
rgerganov committed 28 days ago
Verified 68ee98ae
server : log requests to /v1/completions (#16495)
rgerganov committed 28 days ago
Verified cdb6da46
cmake : Dont define XOPENSOURCE on AIX (#16481)
mehendarkarprajwal committed 28 days ago
Verified 6d69ab3f
webui: updated the chat service to only include max_tokens in the req… (#16489)
ServeurpersoCom committed 29 days ago
Verified 1faa13a1
cpu : optimize the ggml NORM operation (#15953)
duduta committed 29 days ago
Verified 1deee0f8
server : host-memory prompt caching (#16391)
ggerganov committed 29 days ago
Verified d00cbea6
No markdown in cot (#16483)
ServeurpersoCom committed 29 days ago
Verified 8328fd4b
model-conversion : add support for SentenceTransformers (#16387)
danbev committed 29 days ago
Verified 56b47958
ci: add ARM64 Kleidiai build and test support (#16462)
sudhiarm committed 29 days ago
Verified 2c0d875a
CANN: Improve ACL graph matching (#16166)
noemotiovon committed 29 days ago
Verified aa4711d3
kleidiai: kernel interface refactoring (#16460)
chaxu01 committed 29 days ago
Verified d80d6d24
[SYCL] refactor soft_max, add soft_max_back (#16472)
NeoZhangJianyu committed 29 days ago
Verified b2602137
model: EmbeddingGemma Adding Support for SentenceTransformers Dense Modules (#16367)
sfallah committed 29 days ago
Verified e08db425
refactor: centralize CoT parsing in backend for streaming mode (#16394)
ServeurpersoCom committed 30 days ago
Verified 12bbc3fa
Disable CUDA host buffers on integrated GPUs (#16308)
ai-fonsi committed 30 days ago
Verified 9d088284
server : fix cancel pending task (#16467)
issixx committed 30 days ago
Verified d2ee056e
metal : mark FA blocks (#16372)
ggerganov committed 30 days ago
Verified b2c08c9e
server : improve context checkpoint logic (#16440)
ggerganov committed 30 days ago
Verified 7fdd16b4
ggml webgpu: profiling, CI updates, reworking of command submission (#16452)
reeselevine committed 31 days ago
Verified 74b8fc17
Terms Of Use Privacy Policy Refund Policy Impressum