ggerganov/llama.cpp

Pull Requests Commits

ngxson committed 2 hours ago

5aa6625f

ngxson committed 2 hours ago

951fa5ca

Avoid PDL race conditions by disabling __restrict__ when PDL is used (#24030)

aendk committed 5 hours ago

Verified 9e58d4d6

ggml-cpu: use runtime SVE width in FWHT (#24059)

chaxu01 committed 6 hours ago

Verified 3571fa54

cuda: reserve space for quantize kv-cache at startup (#23907)

am17an committed 6 hours ago

Verified f8f0a47a

tests : add support for qwen3 SSM archs (#24031)

ggerganov committed 10 hours ago

Verified 06938ac1

update BoringSSL to 0.20260526.0 (#23794)

cabelo committed 11 hours ago

Verified d545a2a9

ci : disable ccache for msvc windows release jobs (#23911)

ggerganov committed 12 hours ago

Verified 4da6370d

arg : removed unecesary mmproj download when users pass --no-mmproj (#23425)

ryan-mangeno committed 12 hours ago

Verified e3666269

opencl: use flat variants of q4_K and q6_K gemv for very large M (#24006)

lhez committed 20 hours ago

Verified 63e66fdd

hexagon: profiler output fix and script updates (#24042)

max-krasnyansky committed 20 hours ago

Verified 5c394fdc

model: add Mellum architecture (#23966)

Xarbirus committed 22 hours ago

Verified 4fb16ecc

model : support granite multilingual embeddings R2 (ibm-granite/granite-embedding-{97,311}m-multilingual-r2) (#22716)

hansolosan committed 1 day ago

Verified bfb4308b

StepFun 3.5 MTP (#23274)

pwilkin committed 1 day ago

Verified 2187e003

common : fix state save in common_prompt_batch_decode (#23468)

danbev committed 1 day ago

Verified 0b715406

server: add SSE ping interval (#24013)

ngxson committed 1 day ago

Verified 60130d18

ci : reduce self-hosted server workflow jobs (#24012)

ggerganov committed 1 day ago

Verified a468b890

docs : update HOWTO-add-model.md (#23883)

Xarbirus committed 1 day ago

Verified d5ab0834

ui: simplify network error handling (#23431)

socram8888 committed 1 day ago

Verified 69cea5b6

ui: Add Thinking mode toggle with reasoning effort levels + improvements for Chat Form Add Action UI (#23434)

allozaur committed 1 day ago

Verified f8e67fc5

kv-cache : SWA checkpoints store only non-masked cells (#23981)

ggerganov committed 1 day ago

Verified 23653159

convert : support Step3.7-Flash (#23845)

forforever73 committed 1 day ago

Verified f7a0777a

llama : deprecate `llama_set_warmup` (#24009)

ggerganov committed 1 day ago

Verified 4f3a4beb

hexagon: MUL_MAT, MUL_MAT_ID, FLASH_ATTN and GDN cleanup and optimizations for latest models (#23989)

max-krasnyansky committed 1 day ago

Verified 8f7f3bf1

hexagon: add gelu_quick (#24007)

tboinovski1 committed 1 day ago

Verified d178a118

server: real-time reasoning interruption via control endpoint (#23971)

ServeurpersoCom committed 1 day ago

Verified 354ebac8

clean up unused variables warnings (#23975)

anavp-nvidia committed 1 day ago

Verified 1fd5f480

opencl: fix compiler warnings for non-adreno path (#23922)

lhez committed 1 day ago

Verified 210a6570

revert to using global_invocation_id for cpy shader (#23955)

yomaytk committed 1 day ago

Verified b8275a8a

speculative : fix n_outputs_max and remove draft-simple auto-enable (#23988)

ggerganov committed 1 day ago

Verified 5dcb7116

Older