ggml-org/llama.cpp

Pull Requests Commits

adapt to upstream changes

0cc4m committed 44 days ago

f370471a

server: add --models-memory-max parameter to allow dynamically unloading models when they exceed a memory size threshold

0cc4m committed 44 days ago

eac4c8b7

ci: hip-quality-check: update vgpr spill ignore list (#26859)

IMbackK committed 44 days ago

Verified 70448594

model-conversion : use save_output_data for causual embeddings [no ci] (#26890)

danbev committed 44 days ago

Verified 1138b851

tests : fix running server tests on windows (#26889)

ggerganov committed 44 days ago

Verified 9afff1b7

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

0cc4m committed 44 days ago

Verified 153d324b

tests : clean-up server test, use `tests.sh` in ci (#26886)

ggerganov committed 44 days ago

Verified b3df5728

tests : disable backend sampler hip multi output (#26878)

jimw567 committed 44 days ago

Verified 4801e3c5

model : fix SWA not being enabled for EXAONE 4.5 (#26848)

junmo-kim committed 44 days ago

Verified 14e78dde

common/peg : suppress incomplete escape sequences (#26780)

aldehir committed 44 days ago

Verified 48d22e29

ggml-webgpu: fix CI errors from #25025 and #25262 (#26566)

yomaytk committed 44 days ago

Verified 84f71294

Address review comment of PR 25532 (#26852)

gaugarg-nv committed 45 days ago

Verified 030ebb55

opencl: transpose the K tile in local memory for FA prefill kernels (#26428)

wanghqc committed 45 days ago

Verified 689e227d

ci : target ROCm 7.14 for build and release (#25775)

superm1 committed 45 days ago

Verified 0666ad2b

llama : support multi-output backend sampling (#25532)

gaugarg-nv committed 45 days ago

Verified dd1ea524

ggml-cpu : fix CPU affinity mask being ignored on Android (#26838)

hiteshchopra11 committed 45 days ago

Verified d2f83055

ggml : require contiguous src for ROLL on CUDA and Metal (#25928)

devYRPauli committed 45 days ago

Verified f8def7fe

ui: UI/chat form follow ups (#26743)

ServeurpersoCom committed 45 days ago

Verified 4dee52f8

ci : don't specify python version in server-sanitize for broader runner compatibility (#26840)

CISC committed 45 days ago

Verified e5275f6f

server: add more tool isolation support (ssh remote + podman rootless) (#26774)

ServeurpersoCom committed 45 days ago

Verified 4ae84dea

model: Muse Glimmer Support (#26841)

pcuenca committed 45 days ago

Verified 62bf73d2

chat : Align Laguna-S-2.1 chat template to huggingface (#26232)

crusaderky committed 45 days ago

Verified a52077c4

vendor: sync subprocess.h and drop local patches (#26808)

ServeurpersoCom committed 45 days ago

Verified 4c6766fd

llama: Restore quantization of mmprojs (#26818)

pcuenca committed 45 days ago

Verified 86c298fb

ci: Add support for CUDA 13.4 ARM64 builds for Windows (#26650)

shivamkumard-ctrl committed 45 days ago

Verified 2e2d99cf

model: add MTP support for Nemotron model (#26725)

ruixiang63 committed 45 days ago

Verified 7a20b417

vendor : update cpp-httplib to 0.53.0 (#26821)

cabelo committed 45 days ago

Verified e23e9440

model : Granite-Switch Architecture (#25107)

barvhaim committed 45 days ago

Verified 157b81fe

readme : remove dev branches (#26832)

ggerganov committed 45 days ago

Verified 6ad4ab0e

ui: Linting & Formatting scripts (#26819)

allozaur committed 45 days ago

Verified 92d1bb0c

Older