ggerganov/llama.cpp

Pull Requests Commits

tests: add backend copy test

0cc4m committed 2 days ago

d69eeb14

llama : document that only one on-device state can be saved per sequence (#23520)

TimNN committed 2 days ago

Verified 314e7293

ci : install host compiler on android-ndk build (#23630)

aldehir committed 2 days ago

Verified d55fb971

ggml : Parallelize quant LUT init (#23595)

jeffbolznv committed 2 days ago

Verified 826539ce

ui: media attachments before text (#23467)

sfallah committed 2 days ago

Verified b9648764

vendor : update cpp-httplib to 0.45.1 (#23639)

cabelo committed 2 days ago

Verified 9627d0f5

server: fix checkpoints creation (#22929)

jacekpoplawski committed 2 days ago

Verified e2ef8fe4

perplexity : fix even more integer overflows (#23623)

fairydreaming committed 3 days ago

Verified 6d57c26e

ci : move most slim jobs to self-hosted runners (#23619)

ggerganov committed 3 days ago

Verified 28123a39

ci : update build-self-hosted.yml (#23616)

ggerganov committed 3 days ago

Verified 549b9d84

convert : minor fixes for numpy 2.x (#23571)

CISC committed 3 days ago

Verified 5d246a79

cmake : fix ui build (#23592)

aldehir committed 3 days ago

Verified 63248fc3

server: add margin for draft model for `fit` (#23485)

am17an committed 3 days ago

Verified 83eebe9d

TP: fix entirely zero-sized slices per device (#23525)

JohannesGaessler committed 3 days ago

Verified fff63b51

opencl: batch profiling to improve speed and prevent memory leaks (#23495)

shaofeiqi committed 3 days ago

Verified f3061116

hexagon: apply repl optimization in flash attn softmax as #22993 (#23455)

njsyw1997 committed 4 days ago

Verified 1c0f6db5

snapdragon: update windows toolchain to use hsdk v6.6.0.0 (#23552)

aparmp-quic committed 4 days ago

Verified cec51c7a

cmake/ui : refactor the build (#23352)

aldehir committed 4 days ago

Verified b22ff4b7

requirements : bump torch to 2.11.0 (#23503)

adityasingh2400 committed 4 days ago

Verified c0c7e147

model : add NVFP4 MTP scale tensors (#23563)

michaelw9999 committed 4 days ago

Verified b0df4c0c

ggml : Check the right iface method before using the fallback 2d get (#23514)

dskwe committed 4 days ago

Verified a4974763

vulkan: fix windows find_package of SPIRV-Headers (#23215)

jeffbolznv committed 4 days ago

Verified 95405ac6

opencl: generalize Adreno MoE kernels on M (#23449)

shawngu-quic committed 5 days ago

Verified 0f3cb3fc

server: only parse empty msg if continuing an assistant msg (#23506)

aldehir committed 5 days ago

Verified 1acee6bf

perplexity : fix integer overflow (#23496)

fairydreaming committed 5 days ago

Verified ef570f63

SYCL: improve MoE prefill throughput (#23142)

sanmai committed 5 days ago

Verified cc9e3312

sycl : Level Zero detection in ggml_sycl_init (#23097)

sanmai committed 5 days ago

Verified bcfd1989

SYCL : gated_delta_net K>1 (#23174)

karavayev committed 5 days ago

Verified 56f16f23

SYCL: add BF16 to DMMV kernel path (~4x tg speedup on Intel Arc) (#21580)

PMZFX committed 5 days ago

Verified 8cc67efc

docs: Update documentation with Granite 4.0/4.1 (#23404)

jesus-talavera-ibm committed 5 days ago

Verified 95feeab5

Older