ngxson/llama.cpp

Pull Requests Commits

ggerganov committed 124 days ago

Verified 2ba14433

ngxson committed 126 days ago

016f8b40

move the chat template print to init()

ngxson committed 126 days ago

2c9fe91e

add req.headers

ngxson committed 126 days ago

68d5c6f8

more generic handler

ngxson committed 126 days ago

4d37cee5

bring back the "server is listening on" message

ngxson committed 127 days ago

55ccf46b

improve usage of next()

ngxson committed 127 days ago

1bc41f60

Merge branch 'master' into xsn/split_http_server_context

ngxson committed 127 days ago

8dbe547b

model : add AfmoeForCausalLM support (#16477)

bartowski1182 committed 127 days ago

Verified e1fcf8b0

fix : Dangling pointer for non-empty trigger words in lazy grammar construction (#17048)

marek-hradil committed 127 days ago

Verified 6cd0cf72

server : fix "can batch with" bug (#17263)

ggerganov committed 127 days ago

Verified d396b437

metal : support argsort for ne00 > 1024 (#17247)

ggerganov committed 128 days ago

Verified 45c6ef73

metal : make the FA extra sizes consistent (#17143)

ggerganov committed 128 days ago

Verified 2606b0ad

readme : add RVV,ZVFH,ZFH,ZICBOP support for RISC-V (#17259)

ixgbe committed 128 days ago

Verified 307772fc

Better UX for handling multiple attachments in WebUI (#17246)

allozaur committed 128 days ago

Verified f1bad23f

ggml-cpu: handle 3d tensors in repack mat_mul (#17241)

Alcpz committed 128 days ago

Verified becc4816

server: fixing naming conflict res_error (#17243)

ngxson committed 128 days ago

Verified c4abcb24

ggml : add ops SOFTPLUS, EXPM1, TRI, SOLVE_TRI, CUMSUM (#17063)

pwilkin committed 128 days ago

Verified 389ac78b

vulkan: remove shell call from vulkan-shaders-gen tool, revert file check (#17219)

0cc4m committed 128 days ago

Verified a19bd6f7

sched : fix reserve ignoring user tensor assignments (#17232)

slaren committed 128 days ago

Verified dd091e52

ggml-cpu : add RISC-V vector intrinsic support for silu and cvar operations (#17227)

ixgbe committed 128 days ago

Verified 1215dde7

metal: accelerated conv2d (#17175)

bghira committed 128 days ago

Verified 0cfb1916

Revert "ggml-cpu: handle 3d tensors in repack mat_mul (#17030)" (#17233)

ggerganov committed 128 days ago

Verified 2776db6c

add some comments

ngxson committed 128 days ago

cd104700

ngxson committed 129 days ago

da458d68

use safe_json_to_str for SSE

ngxson committed 129 days ago

8c7fbec4

do not call sink.write on empty data

ngxson committed 129 days ago

fc35e916

ggml-cpu : use template for argsort (#17222)

slaren committed 129 days ago

Verified 879dec34

ngxson committed 129 days ago

9917e044

fix case where only one stream chunk is returned

ngxson committed 129 days ago

3be8a3ac

Older