ggml-org/llama.cpp

Pull Requests Commits

docs, pass copy details

pwilkin committed 12 hours ago

532a8ebd

fix mul_mat_id stats, add throughput stat, add envvar trigger, add concurrent mode fix

pwilkin committed 12 hours ago

e02ccae0

fix builds, integrate vulkan profiler, fix copy events, fix export

pwilkin committed 13 hours ago

d9af8173

Fix more missing backend stuff (and Python errors)

pwilkin committed 13 hours ago

2a38cd7e

add second dimension to reported tensors, fix Mac build, add missing initializer to all backends

pwilkin committed 13 hours ago

d782a04e

feat: cool profiler thingy

pwilkin committed 13 hours ago

c08e5f73

add missing ROPE_FACTORS_LONG/SHORT for MiniCPM (#21150)

CISC committed 15 hours ago

Verified 7c203670

Optimize MOE GEMV kernel for BS > 1. (#20905)

gaugarg-nv committed 17 hours ago

Verified ec16a072

hexagon: dma optimizations (mostly fixing regressions) (#21137)

max-krasnyansky committed 19 hours ago

Verified f5d1c417

devops: including compute-runtime for intel.Dockerfile (#21076)

WizardlyBump17 committed 1 day ago

Verified 2405d59c

[SYCL] Enhance build script to use half cores to build, avoid OS hang (#21093)

arthw committed 1 day ago

Verified afe65aa2

fix **/x glob matching (#21129)

CISC committed 1 day ago

Verified 65097181

common/parser: fix handling of tool definition with missing properties key (#21128)

pwilkin committed 1 day ago

Verified 98ae0a0d

common : add character class support to glob_match (#21111)

CISC committed 1 day ago

Verified 3a14a542

WebUI: Replace illegal nested button elements (#21026)

bluemoehre committed 1 day ago

Verified 96818972

common/json-schema: fix: handle non-capturing groups (?:...) in JSON schema pattern converter (#21124)

XciD committed 1 day ago

Verified e397d388

common : add reasoning_format = none support to gpt-oss (#21094)

aldehir committed 1 day ago

Verified e6f2ec01

server : fix processing of multiple back-to-back mtmd chunks (#21107)

ggerganov committed 1 day ago

Verified edfb440a

ci : gracefully shut down the server (#21110)

angt committed 1 day ago

Verified 3d66da18

Document custom default webui preferences in server README (#19771)

woof-dog committed 1 day ago

Verified 82b703f8

webui: Conversation forking + branching improvements (#21021)

allozaur committed 1 day ago

Verified 51a84efc

vendor : update cpp-httplib to 0.40.0 (#21100)

angt committed 2 days ago

Verified b0f0dd3e

vulkan: add noncontiguous GLU support (#21081)

0cc4m committed 2 days ago

Verified 0eb47641

common/parser: fix reasoning whitespace bugs + extra parser tests (#21085)

pwilkin committed 2 days ago

Verified 1f5d15e6

cli : add /glob command (#21084)

CISC committed 2 days ago

Verified c46758d2

docker : fix and enable ARM64 image build (#20929)

Ts-sound committed 2 days ago

Verified bf934f28

server : add custom socket options to disable SO_REUSEPORT (#21056)

angt committed 2 days ago

Verified 5c1a7b83

common : inhibit lazy grammar sampler while reasoning is active (#20970)

aldehir committed 2 days ago

Verified 59d84020

server: Introduce LLAMA_BUILD_WEBUI build flag to allow disabling the embedded web ui (#20158)

kushagharahi committed 2 days ago

Verified ff934e29

hexagon: support for IQ4_NL and MXFP4 (#21018)

njsyw1997 committed 2 days ago

Verified ee051c1e

Older