ggml-org/llama.cpp

Pull Requests Commits

use memcpy for small copies across host-visible memory

0cc4m committed 42 days ago

0aac18be

add semi-async staging copy and use it over syncfd for small copies

0cc4m committed 42 days ago

53e8d97e

swap dmabuf check order

0cc4m committed 42 days ago

37e842ae

use allocator instead of hop2

0cc4m committed 42 days ago

43ed6f25

use sync_fd binary semaphores for cross-driver synchronization

0cc4m committed 42 days ago

e9c5242f

double buffering

0cc4m committed 42 days ago

fd1d315d

fixes, disable semaphore sharing on Nvidia + non-Nvidia

0cc4m committed 42 days ago

412c0f19

0cc4m committed 42 days ago

69855b47

vulkan: add optimized device to device copy function

0cc4m committed 42 days ago

3d8b3e16

sycl : fix failed ut cases of norm (#25044)

arthw committed 42 days ago

Verified 9bebfcb4

vulkan: fix step operator for 0 input (#25036)

0cc4m committed 42 days ago

Verified 0b6529d8

binaries : Improve rpc-server and export-graph-ops names. (#25045)

ckastner committed 42 days ago

Verified c299a92c

ci : add windows-openvino to check-release (#25022)

CISC committed 42 days ago

Verified 0275c0f8

tests : fix test-chat-template --no-common option (#25075)

CISC committed 42 days ago

Verified 83d385b4

app : allow --version, --licenses & --help (#25054)

angt committed 42 days ago

Verified 050ee92d

sched : reintroduce less synchronizations during split compute (#20793)

aendk committed 43 days ago

Verified 3fc4e105

devops : add llama in all docker images (#25035)

angt committed 43 days ago

Verified 5d8ccdf9

arg: fix handling --spec-draft-hf and --hf-repo-v (#25043)

ngxson committed 43 days ago

Verified 024930c6

openvino: Update to OV 2026.2.1, self-contained release packages, operator improvements (#24974)

ravi9 committed 43 days ago

Verified 5397c361

ggerganov committed 43 days ago

e7ea94af

ggml : bump version to 0.15.3 (ggml/1550)

ggerganov committed 43 days ago

96183e98

vulkan: opt mul_mat_vecq for mi50 (#22933)

chraac committed 43 days ago

Verified 487a6cc1

vulkan: add INTEL_XE1 arch enum and enable coopmat1 on Intel Xe-LPG Plus (#24404)

fish-jiang committed 43 days ago

Verified 5a6a0dd7

ui: fix accessibility for hover-gated interactive elements assisted by claude(in debugging and tests) (#24727)

sanjayahari committed 43 days ago

Verified ded1561b

vulkan: Workaround compiler bug in conv2d coopmat2 path (#24924)

jeffbolznv committed 43 days ago

Verified 9df06805

CUDA: add cublasSgemmBatched mapping for HIP/MUSA vendor headers (#25033)

leonardHONG committed 43 days ago

Verified 2f18fe13

ggml-cpu: fix SVE leftover path in ggml_vec_dot_f32 (#24699)

tdakhran committed 43 days ago

Verified c16c35b8

server + ui: SSE Replay Buffer (#23226)

ServeurpersoCom committed 43 days ago

Verified 1a87dcdc

sycl : clamp softmax input to avoid underflow (#24941)

Jassieluo committed 43 days ago

Verified e7e3f350

mtmd: add more validations (#25013)

ngxson committed 43 days ago

Verified b11f7c16

Older