ngxson/llama.cpp

Pull Requests Commits

Merge branch 'master' into xsn/check_vendor_ci

ngxson committed 33 days ago

496f01f6

ggml-cpu: handle 3d tensors in repack mat_mul (#17030)

Alcpz committed 33 days ago

Verified 1c398dc9

cmake : cleanup (#17199)

angt committed 33 days ago

Verified 52cf111b

cmake : move OpenSSL linking to vendor/cpp-httplib (#17177)

angt committed 33 days ago

Verified 78010a0d

move to dedicated workflow, only run on related files changed

ngxson committed 33 days ago

dc774ecf

CANN: Add L2_NORM op support (#16856)

TecJesh committed 33 days ago

Verified 655cddd1

[SYCL]fix ci crash about SSM_CONV (#17169)

NeoZhangJianyu committed 34 days ago

Verified 5da76649

CANN: GGML_CANN_ACL_GRAPH works only USE_ACL_GRAPH enabled (#16861)

rauletorresc committed 34 days ago

Verified 23a46ce9

hexagon: various Op fixes (#17135)

max-krasnyansky committed 34 days ago

Verified c273d753

use dev version of miniaudio

ngxson committed 34 days ago

ec7f608d

ci: add check vendor job

ngxson committed 34 days ago

d74c3487

disable rms norm mul rope for chips with no fp16 rte (#17134)

netrunnereve committed 34 days ago

Verified 7d019cff

ci: add Arm-hosted Graviton4 runner (#17021)

sudhiarm committed 34 days ago

Verified 3fe36c32

vendor: split httplib to cpp/h files (#17150)

ngxson committed 34 days ago

Verified 1d45b422

ggml-cpu : add RISC-V RVV (Zvfh) optimization for FP16 to FP32 conversion (#17161)

ixgbe committed 34 days ago

Verified ca484406

ggml-cpu: templateify ggml_compute_forward_rope_f32 and _f16 (#16805)

duduta committed 34 days ago

Verified 73460f62

kleidiai: add optimized per-channel kernels for Q8_0 (#16993)

chaxu01 committed 34 days ago

Verified 8c583242

cmake : add version to all shared object files (#17091)

furrysalamander committed 34 days ago

Verified 4a5b8aff

Install rpc-server when GGML_RPC is ON. (#17149)

nbp committed 34 days ago

Verified d2d62693

convert : register UMT5Model architecture for T5 conversion (#17160)

levkropp committed 34 days ago

Verified 2fc392ce

opencl: add fastdiv and use it in set_rows, ported from cuda (#17090)

lhez committed 35 days ago

Verified ece0f5c1

models : move build_inp_out_ids outside loop (#17151)

CISC committed 35 days ago

Verified 7bef6841

cpu: skip NOPs to avoid barriers (#17133)

max-krasnyansky committed 35 days ago

Verified 395e286b

metal : cap threadgroups size of set_rows (#17146)

ggerganov committed 35 days ago

Verified 13730c18

ggml-cpu : inspect -march and -mcpu to found the CPU (#16333)

angt committed 35 days ago

Verified 967eb4b2

vulkan: check glslc executable string (#17144)

0cc4m committed 35 days ago

Verified f117be18

vulkan: fix validation issue introduced by #16868 (#17145)

0cc4m committed 35 days ago

Verified 85234a4b

memory: Hybrid context shift (#17009)

gabe-l-hart committed 35 days ago

Verified 0c74f326

metal : enable tensor API for A19 (#17087)

ggerganov committed 35 days ago

Verified c27efd2b

arm64: add i8mm route with SVE ggml_vec_dot_q4_K_q8_K and ggml_vec_dot_q6_K_… (#15277)

fj-y-saito committed 35 days ago

Verified df70bedd

Older