ngxson/llama.cpp

Pull Requests Commits

PoC CLI using server code

ngxson committed 35 days ago

5bba4fa0

ngxson committed 35 days ago

92a150f9

ngxson committed 35 days ago

66c6fe27

fix exception/error handling

ngxson committed 35 days ago

a2e6a003

add the remaining endpoints

ngxson committed 35 days ago

473b0e58

move server-http and httplib to its own file

ngxson committed 35 days ago

fe98058f

server: split HTTP into its own interface

ngxson committed 35 days ago

45b2fe19

server: (refactor) implement generator-based API for task results (#17174)

ngxson committed 35 days ago

Verified 00c94083

ci: add check vendor job (#17179)

ngxson committed 36 days ago

Verified 017eceed

server: move res_error/res_ok to static function (#17167)

ngxson committed 36 days ago

Verified ee8dd5c6

ggml-cpu: handle 3d tensors in repack mat_mul (#17030)

Alcpz committed 36 days ago

Verified 1c398dc9

cmake : cleanup (#17199)

angt committed 36 days ago

Verified 52cf111b

cmake : move OpenSSL linking to vendor/cpp-httplib (#17177)

angt committed 36 days ago

Verified 78010a0d

CANN: Add L2_NORM op support (#16856)

TecJesh committed 36 days ago

Verified 655cddd1

[SYCL]fix ci crash about SSM_CONV (#17169)

NeoZhangJianyu committed 36 days ago

Verified 5da76649

CANN: GGML_CANN_ACL_GRAPH works only USE_ACL_GRAPH enabled (#16861)

rauletorresc committed 36 days ago

Verified 23a46ce9

hexagon: various Op fixes (#17135)

max-krasnyansky committed 36 days ago

Verified c273d753

disable rms norm mul rope for chips with no fp16 rte (#17134)

netrunnereve committed 36 days ago

Verified 7d019cff

ci: add Arm-hosted Graviton4 runner (#17021)

sudhiarm committed 36 days ago

Verified 3fe36c32

vendor: split httplib to cpp/h files (#17150)

ngxson committed 37 days ago

Verified 1d45b422

ggml-cpu : add RISC-V RVV (Zvfh) optimization for FP16 to FP32 conversion (#17161)

ixgbe committed 37 days ago

Verified ca484406

ggml-cpu: templateify ggml_compute_forward_rope_f32 and _f16 (#16805)

duduta committed 37 days ago

Verified 73460f62

kleidiai: add optimized per-channel kernels for Q8_0 (#16993)

chaxu01 committed 37 days ago

Verified 8c583242

cmake : add version to all shared object files (#17091)

furrysalamander committed 37 days ago

Verified 4a5b8aff

Install rpc-server when GGML_RPC is ON. (#17149)

nbp committed 37 days ago

Verified d2d62693

convert : register UMT5Model architecture for T5 conversion (#17160)

levkropp committed 37 days ago

Verified 2fc392ce

opencl: add fastdiv and use it in set_rows, ported from cuda (#17090)

lhez committed 37 days ago

Verified ece0f5c1

models : move build_inp_out_ids outside loop (#17151)

CISC committed 37 days ago

Verified 7bef6841

cpu: skip NOPs to avoid barriers (#17133)

max-krasnyansky committed 37 days ago

Verified 395e286b

metal : cap threadgroups size of set_rows (#17146)

ggerganov committed 37 days ago

Verified 13730c18

Older