ngxson/llama.cpp

Pull Requests Commits

CANN: Add cross_entropy_loss op support (#16886)

TecJesh committed 61 days ago

Verified 97d51172

CUDA: fuse rope + set_rows (#16884)

am17an committed 61 days ago

Verified a90eb94c

update SYCL support OPs (#17208)

NeoZhangJianyu committed 61 days ago

Verified 07751f8d

fix slot save/restore handler

ngxson committed 61 days ago

25cc7eb6

fix error responses from http layer

ngxson committed 61 days ago

f428fe58

vocab : correct bounds check for UGM XCDA array access (#17215)

o7si committed 61 days ago

Verified ffb6f3d9

fix missing windows header

ngxson committed 61 days ago

d990534e

CUDA: static assert to prevent misuse of memcpy_1 (#17198)

JohannesGaessler committed 61 days ago

Verified 5d6838b7

ngxson committed 61 days ago

92a150f9

ngxson committed 61 days ago

66c6fe27

fix exception/error handling

ngxson committed 61 days ago

a2e6a003

add the remaining endpoints

ngxson committed 61 days ago

473b0e58

move server-http and httplib to its own file

ngxson committed 61 days ago

fe98058f

docker : preserve .so symlinks for docker container builds (#17214)

furrysalamander committed 61 days ago

Verified 92bb442a

ggml : use std::sort in ggml_argsort CPU implementation (#17211)

ggerganov committed 61 days ago

Verified 374fe09c

Update packages + upgrade Storybook to v10 (#17201)

allozaur committed 61 days ago

Verified 8e878f0c

server: split HTTP into its own interface

ngxson committed 61 days ago

45b2fe19

server: (refactor) implement generator-based API for task results (#17174)

ngxson committed 61 days ago

Verified 00c94083

ci: add check vendor job (#17179)

ngxson committed 61 days ago

Verified 017eceed

server: move res_error/res_ok to static function (#17167)

ngxson committed 61 days ago

Verified ee8dd5c6

ggml-cpu: handle 3d tensors in repack mat_mul (#17030)

Alcpz committed 61 days ago

Verified 1c398dc9

cmake : cleanup (#17199)

angt committed 61 days ago

Verified 52cf111b

cmake : move OpenSSL linking to vendor/cpp-httplib (#17177)

angt committed 62 days ago

Verified 78010a0d

CANN: Add L2_NORM op support (#16856)

TecJesh committed 62 days ago

Verified 655cddd1

[SYCL]fix ci crash about SSM_CONV (#17169)

NeoZhangJianyu committed 62 days ago

Verified 5da76649

CANN: GGML_CANN_ACL_GRAPH works only USE_ACL_GRAPH enabled (#16861)

rauletorresc committed 62 days ago

Verified 23a46ce9

hexagon: various Op fixes (#17135)

max-krasnyansky committed 62 days ago

Verified c273d753

disable rms norm mul rope for chips with no fp16 rte (#17134)

netrunnereve committed 62 days ago

Verified 7d019cff

ci: add Arm-hosted Graviton4 runner (#17021)

sudhiarm committed 62 days ago

Verified 3fe36c32

vendor: split httplib to cpp/h files (#17150)

ngxson committed 62 days ago

Verified 1d45b422

Newer Older