ggml-org/llama.cpp

Pull Requests Commits

use memcpy for small copies across host-visible memory

0cc4m committed 6 days ago

0aac18be

add semi-async staging copy and use it over syncfd for small copies

0cc4m committed 6 days ago

53e8d97e

swap dmabuf check order

0cc4m committed 6 days ago

37e842ae

use allocator instead of hop2

0cc4m committed 6 days ago

43ed6f25

use sync_fd binary semaphores for cross-driver synchronization

0cc4m committed 6 days ago

e9c5242f

double buffering

0cc4m committed 6 days ago

fd1d315d

fixes, disable semaphore sharing on Nvidia + non-Nvidia

0cc4m committed 6 days ago

412c0f19

0cc4m committed 6 days ago

69855b47

vulkan: add optimized device to device copy function

0cc4m committed 6 days ago

3d8b3e16

sycl : fix failed ut cases of norm (#25044)

arthw committed 6 days ago

Verified 9bebfcb4

vulkan: fix step operator for 0 input (#25036)

0cc4m committed 6 days ago

Verified 0b6529d8

binaries : Improve rpc-server and export-graph-ops names. (#25045)

ckastner committed 6 days ago

Verified c299a92c

ci : add windows-openvino to check-release (#25022)

CISC committed 6 days ago

Verified 0275c0f8

tests : fix test-chat-template --no-common option (#25075)

CISC committed 6 days ago

Verified 83d385b4

app : allow --version, --licenses & --help (#25054)

angt committed 6 days ago

Verified 050ee92d

sched : reintroduce less synchronizations during split compute (#20793)

aendk committed 7 days ago

Verified 3fc4e105

devops : add llama in all docker images (#25035)

angt committed 7 days ago

Verified 5d8ccdf9

arg: fix handling --spec-draft-hf and --hf-repo-v (#25043)

ngxson committed 7 days ago

Verified 024930c6

openvino: Update to OV 2026.2.1, self-contained release packages, operator improvements (#24974)

ravi9 committed 7 days ago

Verified 5397c361

ggerganov committed 7 days ago

e7ea94af

ggml : bump version to 0.15.3 (ggml/1550)

ggerganov committed 7 days ago

96183e98

vulkan: opt mul_mat_vecq for mi50 (#22933)

chraac committed 7 days ago

Verified 487a6cc1

vulkan: add INTEL_XE1 arch enum and enable coopmat1 on Intel Xe-LPG Plus (#24404)

fish-jiang committed 7 days ago

Verified 5a6a0dd7

ui: fix accessibility for hover-gated interactive elements assisted by claude(in debugging and tests) (#24727)

sanjayahari committed 7 days ago

Verified ded1561b

vulkan: Workaround compiler bug in conv2d coopmat2 path (#24924)

jeffbolznv committed 7 days ago

Verified 9df06805

CUDA: add cublasSgemmBatched mapping for HIP/MUSA vendor headers (#25033)

leonardHONG committed 7 days ago

Verified 2f18fe13

ggml-cpu: fix SVE leftover path in ggml_vec_dot_f32 (#24699)

tdakhran committed 7 days ago

Verified c16c35b8

server + ui: SSE Replay Buffer (#23226)

ServeurpersoCom committed 7 days ago

Verified 1a87dcdc

sycl : clamp softmax input to avoid underflow (#24941)

Jassieluo committed 7 days ago

Verified e7e3f350

mtmd: add more validations (#25013)

ngxson committed 7 days ago

Verified b11f7c16

Older