ggerganov/llama.cpp

Pull Requests Commits

ggml : add get_alloc_size_n to buffer type interface

ggerganov committed 7 days ago

aa7ee0ba

ggml : address review comments on alloc_buffer_n

ggerganov committed 7 days ago

999c58ee

tests : add descriptions for alloc_buffer_n tests

ggerganov committed 7 days ago

046ed1fc

cont : fix compile warnings

ggerganov committed 7 days ago

ab9ecb18

tests : add alloc_buffer_n coverage

ggerganov committed 7 days ago

9b56fd6a

ggml : add TODO tag for shared buffer split logic

ggerganov committed 7 days ago

9ea4bb47

cont : fix `cur_buf_size` init after flushing a buffer

ggerganov committed 7 days ago

ebea32ef

ggml : add `alloc_buffer_n` to buffer type interface

ggerganov committed 7 days ago

e9f11616

ci : use hf-jobs-cpu-performance, disable pytest workers (#29369)

ggerganov committed 7 days ago

Verified 70596c4d

vulkan: int8 coopmat1 matmul implementation for AMD RDNA3 and RDNA4 (#27952)

0cc4m committed 7 days ago

Verified 70c4e158

vulkan: handle misalignment in conv_2d and conv_3d (#29365)

0cc4m committed 7 days ago

Verified 6b790a9c

vulkan: tune KHR cooperative matrix support for Adreno GPUs (#29328)

Raman-Raje committed 7 days ago

Verified 3423f940

cuda : add conv3d with implicit GEMM (#29137)

leejet committed 7 days ago

Verified 53ed051c

model : add Ling 3.0 VL support (#29151)

aetherbird committed 7 days ago

Verified f830688e

server,common : fix the GCC 12 stringop-overread false positive (again) (#29325)

angt committed 7 days ago

Verified 2b705839

test-save-load-state : print a per-model results table in --models mode (#29316)

ggerganov committed 7 days ago

Verified 4c5957c2

hexagon: reject MUL_MAT_ID when src1 precision is F32 (#29348)

jhen0409 committed 7 days ago

Verified 9710a321

scripts : make-release-desc - link previous release in changelog title (#29336)

ggerganov committed 7 days ago

Verified 013b31c0

convert : allow vision target for DFlash/Dspark (#29339)

tdakhran committed 7 days ago

Verified bd4f514d

server: allow preset to set log file (#29334)

ngxson committed 7 days ago

Verified b9ae43a5

tests: add `-b/--backend` option to test-llama-archs for testing a specific backend (#27372)

yomaytk committed 7 days ago

Verified d2e54583

ci : use hf-jobs-cpu-xl runner in server sanitize workflow (#29297)

ggerganov committed 7 days ago

Verified 6e60f356

opencl: add A8 Q6_K non-MoE dp4a binary kernel (#29057)

shaofeiqi committed 7 days ago

Verified fee39dd9

llama.cpp : bump version to 0.5.0 (#29333)

ggerganov committed 7 days ago

Verified 7fe450e1

ggerganov committed 7 days ago

177cd8cc

ggml : bump version to 0.25.1 (ggml/1637)

ggerganov committed 7 days ago

e4e2f623

CUDA: add a reserve to avoid spurious warning on older GCC builds (#29317)

am17an committed 7 days ago

Verified 66fba63a

common : keep HF cache dir as path, expose UTF-8 only for logs (#29320)

angt committed 7 days ago

Verified bddf8263

metal: add the missing f32 x bf16 mul_mv variants (#28741)

ServeurpersoCom committed 7 days ago

Verified 95753896

CUDA: enable sparse-fa for dsv4 prefill (again) (#29298)

am17an committed 7 days ago

Verified dc9879cf

Older