ngxson/llama.cpp

Pull Requests Commits

rename generator --> reader

ngxson committed 59 days ago

bfa5a70c

Merge branch 'master' into xsn/server_response_generator_refactor

ngxson committed 59 days ago

f3bdded9

server: move res_error/res_ok to static function (#17167)

ngxson committed 59 days ago

Verified ee8dd5c6

ggml-cpu: handle 3d tensors in repack mat_mul (#17030)

Alcpz committed 59 days ago

Verified 1c398dc9

cmake : cleanup (#17199)

angt committed 59 days ago

Verified 52cf111b

cmake : move OpenSSL linking to vendor/cpp-httplib (#17177)

angt committed 59 days ago

Verified 78010a0d

CANN: Add L2_NORM op support (#16856)

TecJesh committed 59 days ago

Verified 655cddd1

[SYCL]fix ci crash about SSM_CONV (#17169)

NeoZhangJianyu committed 59 days ago

Verified 5da76649

CANN: GGML_CANN_ACL_GRAPH works only USE_ACL_GRAPH enabled (#16861)

rauletorresc committed 59 days ago

Verified 23a46ce9

hexagon: various Op fixes (#17135)

max-krasnyansky committed 59 days ago

Verified c273d753

ngxson committed 60 days ago

efd73cf1

disable rms norm mul rope for chips with no fp16 rte (#17134)

netrunnereve committed 60 days ago

Verified 7d019cff

rm redundant check

ngxson committed 60 days ago

31b8b700

add sink.done before return false

ngxson committed 60 days ago

cc2e3977

fix "Response ended prematurely"

ngxson committed 60 days ago

993440ea

moving some code

ngxson committed 60 days ago

440ce931

ngxson committed 60 days ago

88277d80

server: (refactor) implement generator-based API for task results

ngxson committed 60 days ago

dfa24004

ci: add Arm-hosted Graviton4 runner (#17021)

sudhiarm committed 60 days ago

Verified 3fe36c32

vendor: split httplib to cpp/h files (#17150)

ngxson committed 60 days ago

Verified 1d45b422

ggml-cpu : add RISC-V RVV (Zvfh) optimization for FP16 to FP32 conversion (#17161)

ixgbe committed 60 days ago

Verified ca484406

ggml-cpu: templateify ggml_compute_forward_rope_f32 and _f16 (#16805)

duduta committed 60 days ago

Verified 73460f62

kleidiai: add optimized per-channel kernels for Q8_0 (#16993)

chaxu01 committed 60 days ago

Verified 8c583242

cmake : add version to all shared object files (#17091)

furrysalamander committed 60 days ago

Verified 4a5b8aff

Install rpc-server when GGML_RPC is ON. (#17149)

nbp committed 60 days ago

Verified d2d62693

convert : register UMT5Model architecture for T5 conversion (#17160)

levkropp committed 60 days ago

Verified 2fc392ce

opencl: add fastdiv and use it in set_rows, ported from cuda (#17090)

lhez committed 61 days ago

Verified ece0f5c1

models : move build_inp_out_ids outside loop (#17151)

CISC committed 61 days ago

Verified 7bef6841

cpu: skip NOPs to avoid barriers (#17133)

max-krasnyansky committed 61 days ago

Verified 395e286b

metal : cap threadgroups size of set_rows (#17146)

ggerganov committed 61 days ago

Verified 13730c18

Older