ggerganov/llama.cpp

Pull Requests Commits

docs, pass copy details

pwilkin committed 2 days ago

532a8ebd

fix mul_mat_id stats, add throughput stat, add envvar trigger, add concurrent mode fix

pwilkin committed 2 days ago

e02ccae0

fix builds, integrate vulkan profiler, fix copy events, fix export

pwilkin committed 2 days ago

d9af8173

Fix more missing backend stuff (and Python errors)

pwilkin committed 2 days ago

2a38cd7e

add second dimension to reported tensors, fix Mac build, add missing initializer to all backends

pwilkin committed 2 days ago

d782a04e

feat: cool profiler thingy

pwilkin committed 2 days ago

c08e5f73

add missing ROPE_FACTORS_LONG/SHORT for MiniCPM (#21150)

CISC committed 2 days ago

Verified 7c203670

Optimize MOE GEMV kernel for BS > 1. (#20905)

gaugarg-nv committed 2 days ago

Verified ec16a072

hexagon: dma optimizations (mostly fixing regressions) (#21137)

max-krasnyansky committed 2 days ago

Verified f5d1c417

devops: including compute-runtime for intel.Dockerfile (#21076)

WizardlyBump17 committed 2 days ago

Verified 2405d59c

[SYCL] Enhance build script to use half cores to build, avoid OS hang (#21093)

arthw committed 3 days ago

Verified afe65aa2

fix **/x glob matching (#21129)

CISC committed 3 days ago

Verified 65097181

common/parser: fix handling of tool definition with missing properties key (#21128)

pwilkin committed 3 days ago

Verified 98ae0a0d

common : add character class support to glob_match (#21111)

CISC committed 3 days ago

Verified 3a14a542

WebUI: Replace illegal nested button elements (#21026)

bluemoehre committed 3 days ago

Verified 96818972

common/json-schema: fix: handle non-capturing groups (?:...) in JSON schema pattern converter (#21124)

XciD committed 3 days ago

Verified e397d388

common : add reasoning_format = none support to gpt-oss (#21094)

aldehir committed 3 days ago

Verified e6f2ec01

server : fix processing of multiple back-to-back mtmd chunks (#21107)

ggerganov committed 3 days ago

Verified edfb440a

ci : gracefully shut down the server (#21110)

angt committed 3 days ago

Verified 3d66da18

Document custom default webui preferences in server README (#19771)

woof-dog committed 3 days ago

Verified 82b703f8

webui: Conversation forking + branching improvements (#21021)

allozaur committed 3 days ago

Verified 51a84efc

vendor : update cpp-httplib to 0.40.0 (#21100)

angt committed 3 days ago

Verified b0f0dd3e

vulkan: add noncontiguous GLU support (#21081)

0cc4m committed 3 days ago

Verified 0eb47641

common/parser: fix reasoning whitespace bugs + extra parser tests (#21085)

pwilkin committed 3 days ago

Verified 1f5d15e6

cli : add /glob command (#21084)

CISC committed 4 days ago

Verified c46758d2

docker : fix and enable ARM64 image build (#20929)

Ts-sound committed 4 days ago

Verified bf934f28

server : add custom socket options to disable SO_REUSEPORT (#21056)

angt committed 4 days ago

Verified 5c1a7b83

common : inhibit lazy grammar sampler while reasoning is active (#20970)

aldehir committed 4 days ago

Verified 59d84020

server: Introduce LLAMA_BUILD_WEBUI build flag to allow disabling the embedded web ui (#20158)

kushagharahi committed 4 days ago

Verified ff934e29

hexagon: support for IQ4_NL and MXFP4 (#21018)

njsyw1997 committed 4 days ago

Verified ee051c1e

Older