ngxson/llama.cpp

Pull Requests Commits

ggml-cpu: use runtime SVE width in FWHT (#24059)

chaxu01 committed 109 days ago

Verified 3571fa54

cuda: reserve space for quantize kv-cache at startup (#23907)

am17an committed 109 days ago

Verified f8f0a47a

tests : add support for qwen3 SSM archs (#24031)

ggerganov committed 109 days ago

Verified 06938ac1

update BoringSSL to 0.20260526.0 (#23794)

cabelo committed 109 days ago

Verified d545a2a9

ci : disable ccache for msvc windows release jobs (#23911)

ggerganov committed 109 days ago

Verified 4da6370d

arg : removed unecesary mmproj download when users pass --no-mmproj (#23425)

ryan-mangeno committed 109 days ago

Verified e3666269

opencl: use flat variants of q4_K and q6_K gemv for very large M (#24006)

lhez committed 109 days ago

Verified 63e66fdd

hexagon: profiler output fix and script updates (#24042)

max-krasnyansky committed 109 days ago

Verified 5c394fdc

model: add Mellum architecture (#23966)

Xarbirus committed 109 days ago

Verified 4fb16ecc

model : support granite multilingual embeddings R2 (ibm-granite/granite-embedding-{97,311}m-multilingual-r2) (#22716)

hansolosan committed 109 days ago

Verified bfb4308b

StepFun 3.5 MTP (#23274)

pwilkin committed 109 days ago

Verified 2187e003

common : fix state save in common_prompt_batch_decode (#23468)

danbev committed 110 days ago

Verified 0b715406

server: add SSE ping interval (#24013)

ngxson committed 110 days ago

Verified 60130d18

ci : reduce self-hosted server workflow jobs (#24012)

ggerganov committed 110 days ago

Verified a468b890

docs : update HOWTO-add-model.md (#23883)

Xarbirus committed 110 days ago

Verified d5ab0834

ui: simplify network error handling (#23431)

Marcos Del Sol Vives committed 110 days ago

Verified 69cea5b6

ui: Add Thinking mode toggle with reasoning effort levels + improvements for Chat Form Add Action UI (#23434)

allozaur committed 110 days ago

Verified f8e67fc5

kv-cache : SWA checkpoints store only non-masked cells (#23981)

ggerganov committed 110 days ago

Verified 23653159

convert : support Step3.7-Flash (#23845)

forforever73 committed 110 days ago

Verified f7a0777a

llama : deprecate `llama_set_warmup` (#24009)

ggerganov committed 110 days ago

Verified 4f3a4beb

hexagon: MUL_MAT, MUL_MAT_ID, FLASH_ATTN and GDN cleanup and optimizations for latest models (#23989)

max-krasnyansky committed 110 days ago

Verified 8f7f3bf1

hexagon: add gelu_quick (#24007)

tboinovski1 committed 110 days ago

Verified d178a118

server: real-time reasoning interruption via control endpoint (#23971)

ServeurpersoCom committed 110 days ago

Verified 354ebac8

clean up unused variables warnings (#23975)

anavp-nvidia committed 110 days ago

Verified 1fd5f480

opencl: fix compiler warnings for non-adreno path (#23922)

lhez committed 110 days ago

Verified 210a6570

revert to using global_invocation_id for cpy shader (#23955)

yomaytk committed 110 days ago

Verified b8275a8a

speculative : fix n_outputs_max and remove draft-simple auto-enable (#23988)

ggerganov committed 110 days ago

Verified 5dcb7116

nix : add nix-nodejs facilities to build Web UI (#23846)

choener committed 110 days ago

Verified 5aa3a645

opencl: add basic support for q5_0 and q5_1 (#23548)

shaofeiqi committed 110 days ago

Verified 27d9ed83

vendor : update cpp-httplib to 0.46.1 (#23980)

angt committed 110 days ago

Verified 335abed1

Newer Older