ggerganov/llama.cpp

Pull Requests Commits

estimate with to-be-loaded model size included

0cc4m committed 14 hours ago

d4fcbeb4

server: add --models-memory-max parameter to allow dynamically unloading models when they exceed a memory size threshold

0cc4m committed 17 hours ago

879ff512

devops: including compute-runtime for intel.Dockerfile (#21076)

WizardlyBump17 committed 19 hours ago

Verified 2405d59c

[SYCL] Enhance build script to use half cores to build, avoid OS hang (#21093)

arthw committed 1 day ago

Verified afe65aa2

fix **/x glob matching (#21129)

CISC committed 1 day ago

Verified 65097181

common/parser: fix handling of tool definition with missing properties key (#21128)

pwilkin committed 1 day ago

Verified 98ae0a0d

common : add character class support to glob_match (#21111)

CISC committed 1 day ago

Verified 3a14a542

WebUI: Replace illegal nested button elements (#21026)

bluemoehre committed 1 day ago

Verified 96818972

common/json-schema: fix: handle non-capturing groups (?:...) in JSON schema pattern converter (#21124)

XciD committed 1 day ago

Verified e397d388

common : add reasoning_format = none support to gpt-oss (#21094)

aldehir committed 1 day ago

Verified e6f2ec01

server : fix processing of multiple back-to-back mtmd chunks (#21107)

ggerganov committed 1 day ago

Verified edfb440a

ci : gracefully shut down the server (#21110)

angt committed 1 day ago

Verified 3d66da18

Document custom default webui preferences in server README (#19771)

woof-dog committed 1 day ago

Verified 82b703f8

webui: Conversation forking + branching improvements (#21021)

allozaur committed 1 day ago

Verified 51a84efc

vendor : update cpp-httplib to 0.40.0 (#21100)

angt committed 1 day ago

Verified b0f0dd3e

vulkan: add noncontiguous GLU support (#21081)

0cc4m committed 1 day ago

Verified 0eb47641

common/parser: fix reasoning whitespace bugs + extra parser tests (#21085)

pwilkin committed 1 day ago

Verified 1f5d15e6

cli : add /glob command (#21084)

CISC committed 1 day ago

Verified c46758d2

docker : fix and enable ARM64 image build (#20929)

Ts-sound committed 2 days ago

Verified bf934f28

server : add custom socket options to disable SO_REUSEPORT (#21056)

angt committed 2 days ago

Verified 5c1a7b83

common : inhibit lazy grammar sampler while reasoning is active (#20970)

aldehir committed 2 days ago

Verified 59d84020

server: Introduce LLAMA_BUILD_WEBUI build flag to allow disabling the embedded web ui (#20158)

kushagharahi committed 2 days ago

Verified ff934e29

hexagon: support for IQ4_NL and MXFP4 (#21018)

njsyw1997 committed 2 days ago

Verified ee051c1e

webui: Improve Chat Messages initial scroll + auto-scroll logic + add lazy loading with transitions to content blocks (#20999)

allozaur committed 2 days ago

Verified e6f67705

server: remove the verbose_prompt parameter (#21059)

aisk committed 2 days ago

Verified 48cda24c

mtmd: add more sanity checks (#21047)

ngxson committed 2 days ago

Verified 871f1a2d

server: add built-in tools backend support (#20898)

ngxson committed 2 days ago

Verified 20197b6f

rpc : proper handling of data pointers to CPU buffers (#21030)

rgerganov committed 2 days ago

Verified ba38f3be

completion : session_tokens insert range in completion tool (no-op → correct) (#20917)

mtmcp committed 2 days ago

Verified 37f230dd

completion : Fix segfault on model load failure (#21049)

mtmcp committed 2 days ago

Verified a308e584

Older