ggml-org/llama.cpp

Pull Requests Commits

llama_encode : only force non-causal attention for enc-dec models

cebtenzzre committed 209 days ago

b06a954b

Vulkan: Add f32 accumulator support to quantized mul mat to fix GLM4 32B incoherence (#13607)

0cc4m committed 209 days ago

Verified 8960efd0

sycl : backend documentation review (#13544)

Alberto Cabrera Pérez committed 209 days ago

Verified 725f23f1

mtmd : add vision support for llama 4 (#13282)

ngxson committed 209 days ago

Verified 92ecdcc0

ci : upgraded oneAPI version in SYCL workflows and dockerfile (#13532)

Alberto Cabrera Pérez committed 209 days ago

Verified f71f40a2

ggerganov committed 209 days ago

d30cb5a7

mnist: fix segmentation fault (ggml/1227)

JohannesGaessler committed 209 days ago

6c35981a

ggml : fix apple OS check in ggml_print_backtrace (ggml/1229)

slaren committed 209 days ago

8b5e19ae

ggml : Fix missing backtrace on Linux (ggml/1228)

danielzgtg committed 209 days ago

60aea028

fix: check model pointer validity before use (#13631)

D2hugging committed 209 days ago

Verified 9c55e5c5

CANN: Support MOE Model MUL_MAT_ID (#13042)

noemotiovon committed 209 days ago

Verified 33d7aed4

server : added --no-prefill-assistant flag (#13608)

isaac-mcfadyen committed 211 days ago

Verified 6a2bc8bf

cmake: use the current build config for vulkan-shaders-gen (#13595)

giladgd committed 211 days ago

Verified e3a7cf6c

parallel : add option for non-shared and larger prompts (#13598)

ggerganov committed 211 days ago

Verified 518329b2

vulkan: move common FA code to flash_attn_base.comp (#13556)

jeffbolznv committed 211 days ago

Verified 2f5a4e1e

vulkan: use scalar FA rather than coopmat2 when N==1 (#13554)

jeffbolznv committed 211 days ago

Verified 4f41ee11

llguidance : official v0.7.20 release (no actual changes) [noci] (#13594)

CoffeeVampir3 committed 212 days ago

Verified 3e0be1ca

server : do not return error out of context (with ctx shift disabled) (#13577)

ngxson committed 212 days ago

Verified 6aa892ec

webui : improve accessibility for visually impaired people (#13551)

ngxson committed 212 days ago

Verified aea9f8b4

readme : add list of dependencies and their license (#13591)

ngxson committed 212 days ago

Verified 06c1e4ab

releases : use arm version of curl for arm releases (#13592)

slaren committed 212 days ago

Verified 415e40a3

metal : add FA-vec kernel for head size 64 (#13583)

ggerganov committed 212 days ago

Verified 654a6779

llama : print hint when loading a model when no backends are loaded (#13589)

slaren committed 212 days ago

Verified 5364ae4b

ci : add ppc64el to build-linux-cross (#13575)

CISC committed 212 days ago

Verified 7c07ac24

sycl : fixed compilation warnings (#13582)

lslusarczyk committed 212 days ago

Verified 0a338ed0

minja: sync (qwen3) (#13573)

ochafik committed 213 days ago

Verified bc098c3c

gguf : use ggml log system (#13571)

slaren committed 213 days ago

Verified c6a2c9e7

gguf-py : fix disconnect-before-connect in editor-gui (#13569)

danielzgtg committed 213 days ago

Verified 07ad2b6d

convert : fix conversion for llama 4 (#13567)

ngxson committed 213 days ago

Verified c531edfa

sycl: simplify bin_bcast_kernel (#13383)

AD2605 committed 213 days ago

Verified 02cdd2d8

Older